00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2284 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3543 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.043 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.043 The recommended git tool is: git 00:00:00.044 using credential 00000000-0000-0000-0000-000000000002 00:00:00.045 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.065 Fetching changes from the remote Git repository 00:00:00.067 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.090 Using shallow fetch with depth 1 00:00:00.090 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.090 > git --version # timeout=10 00:00:00.138 > git --version # 'git version 2.39.2' 00:00:00.139 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.193 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.193 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.060 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.070 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.079 Checking out Revision 3f5fbcceba25866ebf7e22fd0e5d30548272f62c (FETCH_HEAD) 00:00:04.079 > git config core.sparsecheckout # timeout=10 00:00:04.091 > git read-tree -mu HEAD # timeout=10 00:00:04.106 > git checkout -f 3f5fbcceba25866ebf7e22fd0e5d30548272f62c # timeout=5 00:00:04.123 Commit message: "packer: Bump java's version" 00:00:04.123 > git rev-list --no-walk 3f5fbcceba25866ebf7e22fd0e5d30548272f62c # timeout=10 00:00:04.196 [Pipeline] Start of Pipeline 00:00:04.209 [Pipeline] library 00:00:04.211 Loading library shm_lib@master 00:00:04.211 Library shm_lib@master is cached. Copying from home. 00:00:04.225 [Pipeline] node 00:00:04.233 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.235 [Pipeline] { 00:00:04.243 [Pipeline] catchError 00:00:04.243 [Pipeline] { 00:00:04.254 [Pipeline] wrap 00:00:04.263 [Pipeline] { 00:00:04.271 [Pipeline] stage 00:00:04.273 [Pipeline] { (Prologue) 00:00:04.506 [Pipeline] sh 00:00:04.781 + logger -p user.info -t JENKINS-CI 00:00:04.796 [Pipeline] echo 00:00:04.797 Node: GP11 00:00:04.803 [Pipeline] sh 00:00:05.096 [Pipeline] setCustomBuildProperty 00:00:05.109 [Pipeline] echo 00:00:05.111 Cleanup processes 00:00:05.115 [Pipeline] sh 00:00:05.394 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.394 1704711 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.405 [Pipeline] sh 00:00:05.685 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.685 ++ grep -v 'sudo pgrep' 00:00:05.685 ++ awk '{print $1}' 00:00:05.685 + sudo kill -9 00:00:05.685 + true 00:00:05.699 [Pipeline] cleanWs 00:00:05.709 [WS-CLEANUP] Deleting project workspace... 00:00:05.709 [WS-CLEANUP] Deferred wipeout is used... 00:00:05.715 [WS-CLEANUP] done 00:00:05.719 [Pipeline] setCustomBuildProperty 00:00:05.734 [Pipeline] sh 00:00:06.012 + sudo git config --global --replace-all safe.directory '*' 00:00:06.106 [Pipeline] httpRequest 00:00:06.501 [Pipeline] echo 00:00:06.503 Sorcerer 10.211.164.101 is alive 00:00:06.510 [Pipeline] retry 00:00:06.512 [Pipeline] { 00:00:06.523 [Pipeline] httpRequest 00:00:06.527 HttpMethod: GET 00:00:06.527 URL: http://10.211.164.101/packages/jbp_3f5fbcceba25866ebf7e22fd0e5d30548272f62c.tar.gz 00:00:06.527 Sending request to url: http://10.211.164.101/packages/jbp_3f5fbcceba25866ebf7e22fd0e5d30548272f62c.tar.gz 00:00:06.537 Response Code: HTTP/1.1 200 OK 00:00:06.537 Success: Status code 200 is in the accepted range: 200,404 00:00:06.537 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_3f5fbcceba25866ebf7e22fd0e5d30548272f62c.tar.gz 00:00:12.917 [Pipeline] } 00:00:12.936 [Pipeline] // retry 00:00:12.943 [Pipeline] sh 00:00:13.226 + tar --no-same-owner -xf jbp_3f5fbcceba25866ebf7e22fd0e5d30548272f62c.tar.gz 00:00:13.242 [Pipeline] httpRequest 00:00:13.602 [Pipeline] echo 00:00:13.603 Sorcerer 10.211.164.101 is alive 00:00:13.614 [Pipeline] retry 00:00:13.616 [Pipeline] { 00:00:13.631 [Pipeline] httpRequest 00:00:13.635 HttpMethod: GET 00:00:13.636 URL: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:13.636 Sending request to url: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:13.655 Response Code: HTTP/1.1 200 OK 00:00:13.655 Success: Status code 200 is in the accepted range: 200,404 00:00:13.656 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:01:18.539 [Pipeline] } 00:01:18.556 [Pipeline] // retry 00:01:18.564 [Pipeline] sh 00:01:18.844 + tar --no-same-owner -xf spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:01:22.139 [Pipeline] sh 00:01:22.421 + git -C spdk log --oneline -n5 00:01:22.422 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:22.422 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:22.422 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:22.422 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:22.422 9469ea403 nvme/fio_plugin: add trim support 00:01:22.431 [Pipeline] } 00:01:22.445 [Pipeline] // stage 00:01:22.454 [Pipeline] stage 00:01:22.456 [Pipeline] { (Prepare) 00:01:22.474 [Pipeline] writeFile 00:01:22.490 [Pipeline] sh 00:01:22.772 + logger -p user.info -t JENKINS-CI 00:01:22.784 [Pipeline] sh 00:01:23.066 + logger -p user.info -t JENKINS-CI 00:01:23.077 [Pipeline] sh 00:01:23.359 + cat autorun-spdk.conf 00:01:23.359 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.359 SPDK_TEST_NVMF=1 00:01:23.359 SPDK_TEST_NVME_CLI=1 00:01:23.359 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.359 SPDK_TEST_NVMF_NICS=e810 00:01:23.359 SPDK_RUN_UBSAN=1 00:01:23.359 NET_TYPE=phy 00:01:23.365 RUN_NIGHTLY=1 00:01:23.370 [Pipeline] readFile 00:01:23.398 [Pipeline] withEnv 00:01:23.401 [Pipeline] { 00:01:23.415 [Pipeline] sh 00:01:23.697 + set -ex 00:01:23.698 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:23.698 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:23.698 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.698 ++ SPDK_TEST_NVMF=1 00:01:23.698 ++ SPDK_TEST_NVME_CLI=1 00:01:23.698 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.698 ++ SPDK_TEST_NVMF_NICS=e810 00:01:23.698 ++ SPDK_RUN_UBSAN=1 00:01:23.698 ++ NET_TYPE=phy 00:01:23.698 ++ RUN_NIGHTLY=1 00:01:23.698 + case $SPDK_TEST_NVMF_NICS in 00:01:23.698 + DRIVERS=ice 00:01:23.698 + [[ tcp == \r\d\m\a ]] 00:01:23.698 + [[ -n ice ]] 00:01:23.698 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:23.698 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:23.698 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:23.698 rmmod: ERROR: Module irdma is not currently loaded 00:01:23.698 rmmod: ERROR: Module i40iw is not currently loaded 00:01:23.698 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:23.698 + true 00:01:23.698 + for D in $DRIVERS 00:01:23.698 + sudo modprobe ice 00:01:23.698 + exit 0 00:01:23.706 [Pipeline] } 00:01:23.720 [Pipeline] // withEnv 00:01:23.726 [Pipeline] } 00:01:23.739 [Pipeline] // stage 00:01:23.748 [Pipeline] catchError 00:01:23.749 [Pipeline] { 00:01:23.763 [Pipeline] timeout 00:01:23.763 Timeout set to expire in 1 hr 0 min 00:01:23.765 [Pipeline] { 00:01:23.778 [Pipeline] stage 00:01:23.780 [Pipeline] { (Tests) 00:01:23.793 [Pipeline] sh 00:01:24.073 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.073 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.073 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.073 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:24.073 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.073 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.073 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:24.073 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.073 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:24.073 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:24.073 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:24.073 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:24.073 + source /etc/os-release 00:01:24.073 ++ NAME='Fedora Linux' 00:01:24.073 ++ VERSION='39 (Cloud Edition)' 00:01:24.073 ++ ID=fedora 00:01:24.073 ++ VERSION_ID=39 00:01:24.073 ++ VERSION_CODENAME= 00:01:24.073 ++ PLATFORM_ID=platform:f39 00:01:24.073 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:24.073 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:24.073 ++ LOGO=fedora-logo-icon 00:01:24.073 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:24.073 ++ HOME_URL=https://fedoraproject.org/ 00:01:24.073 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:24.073 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:24.073 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:24.073 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:24.073 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:24.073 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:24.073 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:24.073 ++ SUPPORT_END=2024-11-12 00:01:24.073 ++ VARIANT='Cloud Edition' 00:01:24.073 ++ VARIANT_ID=cloud 00:01:24.073 + uname -a 00:01:24.073 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:24.073 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:25.006 Hugepages 00:01:25.006 node hugesize free / total 00:01:25.006 node0 1048576kB 0 / 0 00:01:25.006 node0 2048kB 0 / 0 00:01:25.006 node1 1048576kB 0 / 0 00:01:25.006 node1 2048kB 0 / 0 00:01:25.006 00:01:25.006 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:25.006 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:25.006 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:25.006 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:25.006 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:25.006 + rm -f /tmp/spdk-ld-path 00:01:25.006 + source autorun-spdk.conf 00:01:25.006 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.006 ++ SPDK_TEST_NVMF=1 00:01:25.006 ++ SPDK_TEST_NVME_CLI=1 00:01:25.006 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.006 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.006 ++ SPDK_RUN_UBSAN=1 00:01:25.006 ++ NET_TYPE=phy 00:01:25.006 ++ RUN_NIGHTLY=1 00:01:25.006 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:25.006 + [[ -n '' ]] 00:01:25.007 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.007 + for M in /var/spdk/build-*-manifest.txt 00:01:25.007 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:25.007 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.007 + for M in /var/spdk/build-*-manifest.txt 00:01:25.007 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:25.007 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.007 + for M in /var/spdk/build-*-manifest.txt 00:01:25.007 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:25.007 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.007 ++ uname 00:01:25.007 + [[ Linux == \L\i\n\u\x ]] 00:01:25.007 + sudo dmesg -T 00:01:25.007 + sudo dmesg --clear 00:01:25.007 + dmesg_pid=1705380 00:01:25.007 + [[ Fedora Linux == FreeBSD ]] 00:01:25.007 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.007 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.007 + sudo dmesg -Tw 00:01:25.007 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:25.007 + [[ -x /usr/src/fio-static/fio ]] 00:01:25.007 + export FIO_BIN=/usr/src/fio-static/fio 00:01:25.007 + FIO_BIN=/usr/src/fio-static/fio 00:01:25.007 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:25.007 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:25.007 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:25.007 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.007 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.007 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:25.007 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.007 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.007 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.007 Test configuration: 00:01:25.007 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.007 SPDK_TEST_NVMF=1 00:01:25.007 SPDK_TEST_NVME_CLI=1 00:01:25.007 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.007 SPDK_TEST_NVMF_NICS=e810 00:01:25.007 SPDK_RUN_UBSAN=1 00:01:25.007 NET_TYPE=phy 00:01:25.007 RUN_NIGHTLY=1 06:59:27 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:25.007 06:59:27 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:25.007 06:59:27 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:25.007 06:59:27 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:25.007 06:59:27 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.007 06:59:27 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.007 06:59:27 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.007 06:59:27 -- paths/export.sh@5 -- $ export PATH 00:01:25.007 06:59:27 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.007 06:59:27 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.007 06:59:27 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.007 06:59:27 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1729054767.XXXXXX 00:01:25.007 06:59:27 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1729054767.5Lhh7r 00:01:25.007 06:59:27 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.007 06:59:27 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:25.007 06:59:27 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:25.007 06:59:27 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.007 06:59:27 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.007 06:59:27 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.007 06:59:27 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:25.007 06:59:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.265 06:59:27 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:25.265 06:59:27 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.265 06:59:27 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.265 06:59:27 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.265 06:59:27 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.265 Wed Oct 16 04:59:27 AM UTC 2024 00:01:25.265 06:59:27 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:25.265 LTS-66-g726a04d70 00:01:25.265 06:59:27 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:25.265 06:59:27 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:25.266 06:59:27 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:25.266 06:59:27 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:25.266 06:59:27 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:25.266 06:59:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.266 ************************************ 00:01:25.266 START TEST ubsan 00:01:25.266 ************************************ 00:01:25.266 06:59:27 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:25.266 using ubsan 00:01:25.266 00:01:25.266 real 0m0.000s 00:01:25.266 user 0m0.000s 00:01:25.266 sys 0m0.000s 00:01:25.266 06:59:27 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:25.266 06:59:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.266 ************************************ 00:01:25.266 END TEST ubsan 00:01:25.266 ************************************ 00:01:25.266 06:59:27 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:25.266 06:59:27 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:25.266 06:59:27 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:25.266 06:59:27 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:25.266 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:25.266 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:25.524 Using 'verbs' RDMA provider 00:01:36.060 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:46.031 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:46.031 Creating mk/config.mk...done. 00:01:46.031 Creating mk/cc.flags.mk...done. 00:01:46.031 Type 'make' to build. 00:01:46.031 06:59:48 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:46.031 06:59:48 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:46.031 06:59:48 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:46.031 06:59:48 -- common/autotest_common.sh@10 -- $ set +x 00:01:46.031 ************************************ 00:01:46.031 START TEST make 00:01:46.031 ************************************ 00:01:46.031 06:59:48 -- common/autotest_common.sh@1104 -- $ make -j48 00:01:46.031 make[1]: Nothing to be done for 'all'. 00:01:54.168 The Meson build system 00:01:54.168 Version: 1.5.0 00:01:54.168 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:54.168 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:54.168 Build type: native build 00:01:54.168 Program cat found: YES (/usr/bin/cat) 00:01:54.168 Project name: DPDK 00:01:54.168 Project version: 23.11.0 00:01:54.168 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:54.168 C linker for the host machine: cc ld.bfd 2.40-14 00:01:54.168 Host machine cpu family: x86_64 00:01:54.168 Host machine cpu: x86_64 00:01:54.168 Message: ## Building in Developer Mode ## 00:01:54.168 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:54.168 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:54.168 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:54.168 Program python3 found: YES (/usr/bin/python3) 00:01:54.168 Program cat found: YES (/usr/bin/cat) 00:01:54.168 Compiler for C supports arguments -march=native: YES 00:01:54.168 Checking for size of "void *" : 8 00:01:54.168 Checking for size of "void *" : 8 (cached) 00:01:54.168 Library m found: YES 00:01:54.168 Library numa found: YES 00:01:54.168 Has header "numaif.h" : YES 00:01:54.168 Library fdt found: NO 00:01:54.168 Library execinfo found: NO 00:01:54.168 Has header "execinfo.h" : YES 00:01:54.168 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:54.168 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:54.168 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:54.168 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:54.168 Run-time dependency openssl found: YES 3.1.1 00:01:54.168 Run-time dependency libpcap found: YES 1.10.4 00:01:54.168 Has header "pcap.h" with dependency libpcap: YES 00:01:54.168 Compiler for C supports arguments -Wcast-qual: YES 00:01:54.168 Compiler for C supports arguments -Wdeprecated: YES 00:01:54.168 Compiler for C supports arguments -Wformat: YES 00:01:54.168 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:54.168 Compiler for C supports arguments -Wformat-security: NO 00:01:54.168 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:54.168 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:54.168 Compiler for C supports arguments -Wnested-externs: YES 00:01:54.168 Compiler for C supports arguments -Wold-style-definition: YES 00:01:54.168 Compiler for C supports arguments -Wpointer-arith: YES 00:01:54.168 Compiler for C supports arguments -Wsign-compare: YES 00:01:54.168 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:54.168 Compiler for C supports arguments -Wundef: YES 00:01:54.168 Compiler for C supports arguments -Wwrite-strings: YES 00:01:54.168 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:54.168 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:54.168 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:54.168 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:54.168 Program objdump found: YES (/usr/bin/objdump) 00:01:54.168 Compiler for C supports arguments -mavx512f: YES 00:01:54.169 Checking if "AVX512 checking" compiles: YES 00:01:54.169 Fetching value of define "__SSE4_2__" : 1 00:01:54.169 Fetching value of define "__AES__" : 1 00:01:54.169 Fetching value of define "__AVX__" : 1 00:01:54.169 Fetching value of define "__AVX2__" : (undefined) 00:01:54.169 Fetching value of define "__AVX512BW__" : (undefined) 00:01:54.169 Fetching value of define "__AVX512CD__" : (undefined) 00:01:54.169 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:54.169 Fetching value of define "__AVX512F__" : (undefined) 00:01:54.169 Fetching value of define "__AVX512VL__" : (undefined) 00:01:54.169 Fetching value of define "__PCLMUL__" : 1 00:01:54.169 Fetching value of define "__RDRND__" : 1 00:01:54.169 Fetching value of define "__RDSEED__" : (undefined) 00:01:54.169 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:54.169 Fetching value of define "__znver1__" : (undefined) 00:01:54.169 Fetching value of define "__znver2__" : (undefined) 00:01:54.169 Fetching value of define "__znver3__" : (undefined) 00:01:54.169 Fetching value of define "__znver4__" : (undefined) 00:01:54.169 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:54.169 Message: lib/log: Defining dependency "log" 00:01:54.169 Message: lib/kvargs: Defining dependency "kvargs" 00:01:54.169 Message: lib/telemetry: Defining dependency "telemetry" 00:01:54.169 Checking for function "getentropy" : NO 00:01:54.169 Message: lib/eal: Defining dependency "eal" 00:01:54.169 Message: lib/ring: Defining dependency "ring" 00:01:54.169 Message: lib/rcu: Defining dependency "rcu" 00:01:54.169 Message: lib/mempool: Defining dependency "mempool" 00:01:54.169 Message: lib/mbuf: Defining dependency "mbuf" 00:01:54.169 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:54.169 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:54.169 Compiler for C supports arguments -mpclmul: YES 00:01:54.169 Compiler for C supports arguments -maes: YES 00:01:54.169 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:54.169 Compiler for C supports arguments -mavx512bw: YES 00:01:54.169 Compiler for C supports arguments -mavx512dq: YES 00:01:54.169 Compiler for C supports arguments -mavx512vl: YES 00:01:54.169 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:54.169 Compiler for C supports arguments -mavx2: YES 00:01:54.169 Compiler for C supports arguments -mavx: YES 00:01:54.169 Message: lib/net: Defining dependency "net" 00:01:54.169 Message: lib/meter: Defining dependency "meter" 00:01:54.169 Message: lib/ethdev: Defining dependency "ethdev" 00:01:54.169 Message: lib/pci: Defining dependency "pci" 00:01:54.169 Message: lib/cmdline: Defining dependency "cmdline" 00:01:54.169 Message: lib/hash: Defining dependency "hash" 00:01:54.169 Message: lib/timer: Defining dependency "timer" 00:01:54.169 Message: lib/compressdev: Defining dependency "compressdev" 00:01:54.169 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:54.169 Message: lib/dmadev: Defining dependency "dmadev" 00:01:54.169 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:54.169 Message: lib/power: Defining dependency "power" 00:01:54.169 Message: lib/reorder: Defining dependency "reorder" 00:01:54.169 Message: lib/security: Defining dependency "security" 00:01:54.169 Has header "linux/userfaultfd.h" : YES 00:01:54.169 Has header "linux/vduse.h" : YES 00:01:54.169 Message: lib/vhost: Defining dependency "vhost" 00:01:54.169 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:54.169 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:54.169 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:54.169 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:54.169 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:54.169 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:54.169 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:54.169 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:54.169 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:54.169 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:54.169 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:54.169 Configuring doxy-api-html.conf using configuration 00:01:54.169 Configuring doxy-api-man.conf using configuration 00:01:54.169 Program mandb found: YES (/usr/bin/mandb) 00:01:54.169 Program sphinx-build found: NO 00:01:54.169 Configuring rte_build_config.h using configuration 00:01:54.169 Message: 00:01:54.169 ================= 00:01:54.169 Applications Enabled 00:01:54.169 ================= 00:01:54.169 00:01:54.169 apps: 00:01:54.169 00:01:54.169 00:01:54.169 Message: 00:01:54.169 ================= 00:01:54.169 Libraries Enabled 00:01:54.169 ================= 00:01:54.169 00:01:54.169 libs: 00:01:54.169 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:54.169 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:54.169 cryptodev, dmadev, power, reorder, security, vhost, 00:01:54.169 00:01:54.169 Message: 00:01:54.169 =============== 00:01:54.169 Drivers Enabled 00:01:54.169 =============== 00:01:54.169 00:01:54.169 common: 00:01:54.169 00:01:54.169 bus: 00:01:54.169 pci, vdev, 00:01:54.169 mempool: 00:01:54.169 ring, 00:01:54.169 dma: 00:01:54.169 00:01:54.169 net: 00:01:54.169 00:01:54.169 crypto: 00:01:54.169 00:01:54.169 compress: 00:01:54.169 00:01:54.169 vdpa: 00:01:54.169 00:01:54.169 00:01:54.169 Message: 00:01:54.169 ================= 00:01:54.169 Content Skipped 00:01:54.169 ================= 00:01:54.169 00:01:54.169 apps: 00:01:54.169 dumpcap: explicitly disabled via build config 00:01:54.169 graph: explicitly disabled via build config 00:01:54.169 pdump: explicitly disabled via build config 00:01:54.169 proc-info: explicitly disabled via build config 00:01:54.169 test-acl: explicitly disabled via build config 00:01:54.169 test-bbdev: explicitly disabled via build config 00:01:54.169 test-cmdline: explicitly disabled via build config 00:01:54.169 test-compress-perf: explicitly disabled via build config 00:01:54.169 test-crypto-perf: explicitly disabled via build config 00:01:54.169 test-dma-perf: explicitly disabled via build config 00:01:54.169 test-eventdev: explicitly disabled via build config 00:01:54.169 test-fib: explicitly disabled via build config 00:01:54.169 test-flow-perf: explicitly disabled via build config 00:01:54.169 test-gpudev: explicitly disabled via build config 00:01:54.169 test-mldev: explicitly disabled via build config 00:01:54.169 test-pipeline: explicitly disabled via build config 00:01:54.169 test-pmd: explicitly disabled via build config 00:01:54.169 test-regex: explicitly disabled via build config 00:01:54.169 test-sad: explicitly disabled via build config 00:01:54.169 test-security-perf: explicitly disabled via build config 00:01:54.169 00:01:54.169 libs: 00:01:54.169 metrics: explicitly disabled via build config 00:01:54.169 acl: explicitly disabled via build config 00:01:54.169 bbdev: explicitly disabled via build config 00:01:54.169 bitratestats: explicitly disabled via build config 00:01:54.169 bpf: explicitly disabled via build config 00:01:54.169 cfgfile: explicitly disabled via build config 00:01:54.169 distributor: explicitly disabled via build config 00:01:54.169 efd: explicitly disabled via build config 00:01:54.169 eventdev: explicitly disabled via build config 00:01:54.169 dispatcher: explicitly disabled via build config 00:01:54.169 gpudev: explicitly disabled via build config 00:01:54.169 gro: explicitly disabled via build config 00:01:54.169 gso: explicitly disabled via build config 00:01:54.169 ip_frag: explicitly disabled via build config 00:01:54.169 jobstats: explicitly disabled via build config 00:01:54.169 latencystats: explicitly disabled via build config 00:01:54.169 lpm: explicitly disabled via build config 00:01:54.169 member: explicitly disabled via build config 00:01:54.169 pcapng: explicitly disabled via build config 00:01:54.169 rawdev: explicitly disabled via build config 00:01:54.169 regexdev: explicitly disabled via build config 00:01:54.169 mldev: explicitly disabled via build config 00:01:54.169 rib: explicitly disabled via build config 00:01:54.169 sched: explicitly disabled via build config 00:01:54.169 stack: explicitly disabled via build config 00:01:54.169 ipsec: explicitly disabled via build config 00:01:54.169 pdcp: explicitly disabled via build config 00:01:54.169 fib: explicitly disabled via build config 00:01:54.169 port: explicitly disabled via build config 00:01:54.169 pdump: explicitly disabled via build config 00:01:54.169 table: explicitly disabled via build config 00:01:54.170 pipeline: explicitly disabled via build config 00:01:54.170 graph: explicitly disabled via build config 00:01:54.170 node: explicitly disabled via build config 00:01:54.170 00:01:54.170 drivers: 00:01:54.170 common/cpt: not in enabled drivers build config 00:01:54.170 common/dpaax: not in enabled drivers build config 00:01:54.170 common/iavf: not in enabled drivers build config 00:01:54.170 common/idpf: not in enabled drivers build config 00:01:54.170 common/mvep: not in enabled drivers build config 00:01:54.170 common/octeontx: not in enabled drivers build config 00:01:54.170 bus/auxiliary: not in enabled drivers build config 00:01:54.170 bus/cdx: not in enabled drivers build config 00:01:54.170 bus/dpaa: not in enabled drivers build config 00:01:54.170 bus/fslmc: not in enabled drivers build config 00:01:54.170 bus/ifpga: not in enabled drivers build config 00:01:54.170 bus/platform: not in enabled drivers build config 00:01:54.170 bus/vmbus: not in enabled drivers build config 00:01:54.170 common/cnxk: not in enabled drivers build config 00:01:54.170 common/mlx5: not in enabled drivers build config 00:01:54.170 common/nfp: not in enabled drivers build config 00:01:54.170 common/qat: not in enabled drivers build config 00:01:54.170 common/sfc_efx: not in enabled drivers build config 00:01:54.170 mempool/bucket: not in enabled drivers build config 00:01:54.170 mempool/cnxk: not in enabled drivers build config 00:01:54.170 mempool/dpaa: not in enabled drivers build config 00:01:54.170 mempool/dpaa2: not in enabled drivers build config 00:01:54.170 mempool/octeontx: not in enabled drivers build config 00:01:54.170 mempool/stack: not in enabled drivers build config 00:01:54.170 dma/cnxk: not in enabled drivers build config 00:01:54.170 dma/dpaa: not in enabled drivers build config 00:01:54.170 dma/dpaa2: not in enabled drivers build config 00:01:54.170 dma/hisilicon: not in enabled drivers build config 00:01:54.170 dma/idxd: not in enabled drivers build config 00:01:54.170 dma/ioat: not in enabled drivers build config 00:01:54.170 dma/skeleton: not in enabled drivers build config 00:01:54.170 net/af_packet: not in enabled drivers build config 00:01:54.170 net/af_xdp: not in enabled drivers build config 00:01:54.170 net/ark: not in enabled drivers build config 00:01:54.170 net/atlantic: not in enabled drivers build config 00:01:54.170 net/avp: not in enabled drivers build config 00:01:54.170 net/axgbe: not in enabled drivers build config 00:01:54.170 net/bnx2x: not in enabled drivers build config 00:01:54.170 net/bnxt: not in enabled drivers build config 00:01:54.170 net/bonding: not in enabled drivers build config 00:01:54.170 net/cnxk: not in enabled drivers build config 00:01:54.170 net/cpfl: not in enabled drivers build config 00:01:54.170 net/cxgbe: not in enabled drivers build config 00:01:54.170 net/dpaa: not in enabled drivers build config 00:01:54.170 net/dpaa2: not in enabled drivers build config 00:01:54.170 net/e1000: not in enabled drivers build config 00:01:54.170 net/ena: not in enabled drivers build config 00:01:54.170 net/enetc: not in enabled drivers build config 00:01:54.170 net/enetfec: not in enabled drivers build config 00:01:54.170 net/enic: not in enabled drivers build config 00:01:54.170 net/failsafe: not in enabled drivers build config 00:01:54.170 net/fm10k: not in enabled drivers build config 00:01:54.170 net/gve: not in enabled drivers build config 00:01:54.170 net/hinic: not in enabled drivers build config 00:01:54.170 net/hns3: not in enabled drivers build config 00:01:54.170 net/i40e: not in enabled drivers build config 00:01:54.170 net/iavf: not in enabled drivers build config 00:01:54.170 net/ice: not in enabled drivers build config 00:01:54.170 net/idpf: not in enabled drivers build config 00:01:54.170 net/igc: not in enabled drivers build config 00:01:54.170 net/ionic: not in enabled drivers build config 00:01:54.170 net/ipn3ke: not in enabled drivers build config 00:01:54.170 net/ixgbe: not in enabled drivers build config 00:01:54.170 net/mana: not in enabled drivers build config 00:01:54.170 net/memif: not in enabled drivers build config 00:01:54.170 net/mlx4: not in enabled drivers build config 00:01:54.170 net/mlx5: not in enabled drivers build config 00:01:54.170 net/mvneta: not in enabled drivers build config 00:01:54.170 net/mvpp2: not in enabled drivers build config 00:01:54.170 net/netvsc: not in enabled drivers build config 00:01:54.170 net/nfb: not in enabled drivers build config 00:01:54.170 net/nfp: not in enabled drivers build config 00:01:54.170 net/ngbe: not in enabled drivers build config 00:01:54.170 net/null: not in enabled drivers build config 00:01:54.170 net/octeontx: not in enabled drivers build config 00:01:54.170 net/octeon_ep: not in enabled drivers build config 00:01:54.170 net/pcap: not in enabled drivers build config 00:01:54.170 net/pfe: not in enabled drivers build config 00:01:54.170 net/qede: not in enabled drivers build config 00:01:54.170 net/ring: not in enabled drivers build config 00:01:54.170 net/sfc: not in enabled drivers build config 00:01:54.170 net/softnic: not in enabled drivers build config 00:01:54.170 net/tap: not in enabled drivers build config 00:01:54.170 net/thunderx: not in enabled drivers build config 00:01:54.170 net/txgbe: not in enabled drivers build config 00:01:54.170 net/vdev_netvsc: not in enabled drivers build config 00:01:54.170 net/vhost: not in enabled drivers build config 00:01:54.170 net/virtio: not in enabled drivers build config 00:01:54.170 net/vmxnet3: not in enabled drivers build config 00:01:54.170 raw/*: missing internal dependency, "rawdev" 00:01:54.170 crypto/armv8: not in enabled drivers build config 00:01:54.170 crypto/bcmfs: not in enabled drivers build config 00:01:54.170 crypto/caam_jr: not in enabled drivers build config 00:01:54.170 crypto/ccp: not in enabled drivers build config 00:01:54.170 crypto/cnxk: not in enabled drivers build config 00:01:54.170 crypto/dpaa_sec: not in enabled drivers build config 00:01:54.170 crypto/dpaa2_sec: not in enabled drivers build config 00:01:54.170 crypto/ipsec_mb: not in enabled drivers build config 00:01:54.170 crypto/mlx5: not in enabled drivers build config 00:01:54.170 crypto/mvsam: not in enabled drivers build config 00:01:54.170 crypto/nitrox: not in enabled drivers build config 00:01:54.170 crypto/null: not in enabled drivers build config 00:01:54.170 crypto/octeontx: not in enabled drivers build config 00:01:54.170 crypto/openssl: not in enabled drivers build config 00:01:54.170 crypto/scheduler: not in enabled drivers build config 00:01:54.170 crypto/uadk: not in enabled drivers build config 00:01:54.170 crypto/virtio: not in enabled drivers build config 00:01:54.170 compress/isal: not in enabled drivers build config 00:01:54.170 compress/mlx5: not in enabled drivers build config 00:01:54.170 compress/octeontx: not in enabled drivers build config 00:01:54.170 compress/zlib: not in enabled drivers build config 00:01:54.170 regex/*: missing internal dependency, "regexdev" 00:01:54.170 ml/*: missing internal dependency, "mldev" 00:01:54.170 vdpa/ifc: not in enabled drivers build config 00:01:54.170 vdpa/mlx5: not in enabled drivers build config 00:01:54.170 vdpa/nfp: not in enabled drivers build config 00:01:54.170 vdpa/sfc: not in enabled drivers build config 00:01:54.170 event/*: missing internal dependency, "eventdev" 00:01:54.170 baseband/*: missing internal dependency, "bbdev" 00:01:54.170 gpu/*: missing internal dependency, "gpudev" 00:01:54.170 00:01:54.170 00:01:54.170 Build targets in project: 85 00:01:54.170 00:01:54.170 DPDK 23.11.0 00:01:54.170 00:01:54.170 User defined options 00:01:54.170 buildtype : debug 00:01:54.170 default_library : shared 00:01:54.170 libdir : lib 00:01:54.170 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:54.170 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:54.170 c_link_args : 00:01:54.170 cpu_instruction_set: native 00:01:54.170 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:54.170 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:54.171 enable_docs : false 00:01:54.171 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:54.171 enable_kmods : false 00:01:54.171 tests : false 00:01:54.171 00:01:54.171 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:54.743 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:54.743 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:54.743 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:54.743 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:54.743 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:54.743 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:54.743 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:54.743 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:54.743 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:54.743 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:54.743 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:54.743 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:54.743 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:54.743 [13/265] Linking static target lib/librte_kvargs.a 00:01:54.743 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:54.743 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:54.743 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:55.003 [17/265] Linking static target lib/librte_log.a 00:01:55.003 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:55.003 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:55.003 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:55.265 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:55.528 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.528 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:55.789 [24/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:55.789 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:55.789 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:55.789 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:55.789 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:55.789 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:55.789 [30/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:55.789 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:55.789 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:55.789 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:55.789 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:55.789 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:55.789 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:55.789 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:55.789 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:55.789 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:55.789 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:55.789 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:55.789 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:55.789 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:55.789 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:55.789 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:55.789 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:55.789 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:55.789 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:55.789 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:55.789 [50/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:55.789 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:55.789 [52/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:55.789 [53/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:55.789 [54/265] Linking static target lib/librte_telemetry.a 00:01:55.789 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:55.789 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:55.789 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:55.789 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:55.789 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:55.789 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:55.789 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:55.789 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:55.789 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:55.790 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:55.790 [65/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:56.050 [66/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:56.050 [67/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:56.050 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:56.050 [69/265] Linking static target lib/librte_pci.a 00:01:56.050 [70/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.050 [71/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:56.050 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:56.050 [73/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:56.050 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:56.050 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:56.050 [76/265] Linking target lib/librte_log.so.24.0 00:01:56.050 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:56.312 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:56.312 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:56.312 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:56.312 [81/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:56.313 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:56.313 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:56.313 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:56.313 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:56.313 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:56.574 [87/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.574 [88/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:56.574 [89/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:56.574 [90/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:56.574 [91/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.574 [92/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:56.574 [93/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:56.574 [94/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:56.574 [95/265] Linking target lib/librte_kvargs.so.24.0 00:01:56.574 [96/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:56.574 [97/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:56.574 [98/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:56.574 [99/265] Linking static target lib/librte_ring.a 00:01:56.574 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:56.574 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:56.836 [102/265] Linking static target lib/librte_meter.a 00:01:56.836 [103/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:56.836 [104/265] Linking target lib/librte_telemetry.so.24.0 00:01:56.836 [105/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:56.836 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:56.836 [107/265] Linking static target lib/librte_eal.a 00:01:56.836 [108/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:56.836 [109/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:56.836 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:56.836 [111/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:56.836 [112/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:56.836 [113/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:56.836 [114/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:56.836 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:56.836 [116/265] Linking static target lib/librte_rcu.a 00:01:56.836 [117/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:56.836 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:56.836 [119/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:56.836 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:57.097 [121/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:57.097 [122/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:57.097 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:57.097 [124/265] Linking static target lib/librte_mempool.a 00:01:57.097 [125/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:57.097 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:57.097 [127/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:57.097 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:57.097 [129/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:57.097 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:57.097 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:57.097 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:57.097 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:57.097 [134/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.097 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:57.359 [136/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:57.359 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:57.359 [138/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:57.359 [139/265] Linking static target lib/librte_cmdline.a 00:01:57.359 [140/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.359 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:57.359 [142/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:57.359 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:57.359 [144/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:57.359 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:57.359 [146/265] Linking static target lib/librte_timer.a 00:01:57.359 [147/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:57.359 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:57.359 [149/265] Linking static target lib/librte_net.a 00:01:57.618 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.618 [151/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:57.618 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:57.618 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:57.618 [154/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:57.877 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:57.877 [156/265] Linking static target lib/librte_dmadev.a 00:01:57.877 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:57.877 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:57.877 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.877 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:57.877 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.877 [162/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:57.877 [163/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:57.877 [164/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:57.877 [165/265] Linking static target lib/librte_hash.a 00:01:57.877 [166/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.877 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:58.135 [168/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:58.135 [169/265] Linking static target lib/librte_compressdev.a 00:01:58.135 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:58.135 [171/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:58.135 [172/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:58.135 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:58.135 [174/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:58.135 [175/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:58.135 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:58.135 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:58.136 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:58.136 [179/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.136 [180/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:58.136 [181/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:58.136 [182/265] Linking static target lib/librte_power.a 00:01:58.136 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:58.136 [184/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:58.136 [185/265] Linking static target lib/librte_reorder.a 00:01:58.136 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:58.136 [187/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.394 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:58.394 [189/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:58.394 [190/265] Linking static target lib/librte_mbuf.a 00:01:58.394 [191/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:58.394 [192/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:58.394 [193/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:58.394 [194/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.394 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:58.394 [196/265] Linking static target drivers/librte_bus_vdev.a 00:01:58.394 [197/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:58.394 [198/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:58.394 [199/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:58.394 [200/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.394 [201/265] Linking static target lib/librte_security.a 00:01:58.394 [202/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.394 [203/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:58.394 [204/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.652 [205/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:58.652 [206/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.653 [207/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:58.653 [208/265] Linking static target drivers/librte_bus_pci.a 00:01:58.653 [209/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.653 [210/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:58.653 [211/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:58.653 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:58.653 [213/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:58.653 [214/265] Linking static target drivers/librte_mempool_ring.a 00:01:58.653 [215/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.653 [216/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.911 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.911 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:58.911 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:58.911 [220/265] Linking static target lib/librte_ethdev.a 00:01:58.911 [221/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.169 [222/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:59.169 [223/265] Linking static target lib/librte_cryptodev.a 00:02:00.103 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.477 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:03.379 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.379 [227/265] Linking target lib/librte_eal.so.24.0 00:02:03.379 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:03.379 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:03.379 [230/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:03.379 [231/265] Linking target lib/librte_dmadev.so.24.0 00:02:03.379 [232/265] Linking target lib/librte_ring.so.24.0 00:02:03.379 [233/265] Linking target lib/librte_timer.so.24.0 00:02:03.379 [234/265] Linking target lib/librte_pci.so.24.0 00:02:03.379 [235/265] Linking target lib/librte_meter.so.24.0 00:02:03.379 [236/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:03.379 [237/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:03.379 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:03.379 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:03.379 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:03.379 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:03.379 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:03.379 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:03.638 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:03.638 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:03.638 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:03.638 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:03.638 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:03.638 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:03.638 [250/265] Linking target lib/librte_net.so.24.0 00:02:03.638 [251/265] Linking target lib/librte_compressdev.so.24.0 00:02:03.638 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:03.896 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:03.896 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:03.896 [255/265] Linking target lib/librte_hash.so.24.0 00:02:03.896 [256/265] Linking target lib/librte_cmdline.so.24.0 00:02:03.896 [257/265] Linking target lib/librte_security.so.24.0 00:02:03.896 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:03.896 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:04.154 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:04.154 [261/265] Linking target lib/librte_power.so.24.0 00:02:06.697 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:06.697 [263/265] Linking static target lib/librte_vhost.a 00:02:08.158 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.158 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:08.158 INFO: autodetecting backend as ninja 00:02:08.158 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:08.724 CC lib/log/log.o 00:02:08.724 CC lib/log/log_flags.o 00:02:08.724 CC lib/log/log_deprecated.o 00:02:08.724 CC lib/ut_mock/mock.o 00:02:08.982 CC lib/ut/ut.o 00:02:08.982 LIB libspdk_ut_mock.a 00:02:08.982 SO libspdk_ut_mock.so.5.0 00:02:08.982 LIB libspdk_log.a 00:02:08.982 LIB libspdk_ut.a 00:02:08.982 SO libspdk_log.so.6.1 00:02:08.982 SO libspdk_ut.so.1.0 00:02:08.982 SYMLINK libspdk_ut_mock.so 00:02:08.982 SYMLINK libspdk_ut.so 00:02:08.982 SYMLINK libspdk_log.so 00:02:09.239 CC lib/dma/dma.o 00:02:09.239 CC lib/util/base64.o 00:02:09.239 CC lib/ioat/ioat.o 00:02:09.239 CXX lib/trace_parser/trace.o 00:02:09.239 CC lib/util/bit_array.o 00:02:09.239 CC lib/util/cpuset.o 00:02:09.239 CC lib/util/crc16.o 00:02:09.239 CC lib/util/crc32.o 00:02:09.239 CC lib/util/crc32c.o 00:02:09.240 CC lib/util/crc32_ieee.o 00:02:09.240 CC lib/util/crc64.o 00:02:09.240 CC lib/util/dif.o 00:02:09.240 CC lib/util/fd.o 00:02:09.240 CC lib/util/file.o 00:02:09.240 CC lib/util/hexlify.o 00:02:09.240 CC lib/util/iov.o 00:02:09.240 CC lib/util/math.o 00:02:09.240 CC lib/util/pipe.o 00:02:09.240 CC lib/util/strerror_tls.o 00:02:09.240 CC lib/util/string.o 00:02:09.240 CC lib/util/uuid.o 00:02:09.240 CC lib/util/fd_group.o 00:02:09.240 CC lib/util/xor.o 00:02:09.240 CC lib/util/zipf.o 00:02:09.240 CC lib/vfio_user/host/vfio_user_pci.o 00:02:09.240 CC lib/vfio_user/host/vfio_user.o 00:02:09.500 LIB libspdk_dma.a 00:02:09.500 SO libspdk_dma.so.3.0 00:02:09.500 SYMLINK libspdk_dma.so 00:02:09.500 LIB libspdk_ioat.a 00:02:09.500 SO libspdk_ioat.so.6.0 00:02:09.500 LIB libspdk_vfio_user.a 00:02:09.500 SO libspdk_vfio_user.so.4.0 00:02:09.500 SYMLINK libspdk_ioat.so 00:02:09.500 SYMLINK libspdk_vfio_user.so 00:02:09.759 LIB libspdk_util.a 00:02:09.759 SO libspdk_util.so.8.0 00:02:10.017 SYMLINK libspdk_util.so 00:02:10.017 CC lib/vmd/vmd.o 00:02:10.017 CC lib/idxd/idxd.o 00:02:10.017 CC lib/json/json_parse.o 00:02:10.017 CC lib/idxd/idxd_user.o 00:02:10.017 CC lib/vmd/led.o 00:02:10.018 CC lib/json/json_util.o 00:02:10.018 CC lib/idxd/idxd_kernel.o 00:02:10.018 CC lib/conf/conf.o 00:02:10.018 CC lib/rdma/common.o 00:02:10.018 CC lib/env_dpdk/env.o 00:02:10.018 CC lib/json/json_write.o 00:02:10.018 CC lib/rdma/rdma_verbs.o 00:02:10.018 CC lib/env_dpdk/memory.o 00:02:10.018 CC lib/env_dpdk/pci.o 00:02:10.018 CC lib/env_dpdk/init.o 00:02:10.018 CC lib/env_dpdk/threads.o 00:02:10.018 CC lib/env_dpdk/pci_ioat.o 00:02:10.018 CC lib/env_dpdk/pci_virtio.o 00:02:10.018 CC lib/env_dpdk/pci_vmd.o 00:02:10.018 CC lib/env_dpdk/pci_idxd.o 00:02:10.018 CC lib/env_dpdk/pci_event.o 00:02:10.018 CC lib/env_dpdk/sigbus_handler.o 00:02:10.018 CC lib/env_dpdk/pci_dpdk.o 00:02:10.018 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:10.018 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:10.018 LIB libspdk_trace_parser.a 00:02:10.276 SO libspdk_trace_parser.so.4.0 00:02:10.276 SYMLINK libspdk_trace_parser.so 00:02:10.276 LIB libspdk_conf.a 00:02:10.276 SO libspdk_conf.so.5.0 00:02:10.276 LIB libspdk_rdma.a 00:02:10.276 SYMLINK libspdk_conf.so 00:02:10.276 LIB libspdk_json.a 00:02:10.276 SO libspdk_rdma.so.5.0 00:02:10.276 SO libspdk_json.so.5.1 00:02:10.534 SYMLINK libspdk_rdma.so 00:02:10.534 SYMLINK libspdk_json.so 00:02:10.534 CC lib/jsonrpc/jsonrpc_server.o 00:02:10.534 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:10.534 CC lib/jsonrpc/jsonrpc_client.o 00:02:10.534 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:10.534 LIB libspdk_idxd.a 00:02:10.534 SO libspdk_idxd.so.11.0 00:02:10.792 SYMLINK libspdk_idxd.so 00:02:10.792 LIB libspdk_vmd.a 00:02:10.792 LIB libspdk_jsonrpc.a 00:02:10.792 SO libspdk_vmd.so.5.0 00:02:10.792 SO libspdk_jsonrpc.so.5.1 00:02:10.792 SYMLINK libspdk_vmd.so 00:02:10.792 SYMLINK libspdk_jsonrpc.so 00:02:11.050 CC lib/rpc/rpc.o 00:02:11.050 LIB libspdk_rpc.a 00:02:11.308 SO libspdk_rpc.so.5.0 00:02:11.308 SYMLINK libspdk_rpc.so 00:02:11.308 CC lib/trace/trace.o 00:02:11.308 CC lib/trace/trace_flags.o 00:02:11.308 CC lib/notify/notify.o 00:02:11.308 CC lib/trace/trace_rpc.o 00:02:11.308 CC lib/notify/notify_rpc.o 00:02:11.308 CC lib/sock/sock.o 00:02:11.308 CC lib/sock/sock_rpc.o 00:02:11.566 LIB libspdk_notify.a 00:02:11.566 SO libspdk_notify.so.5.0 00:02:11.566 SYMLINK libspdk_notify.so 00:02:11.566 LIB libspdk_trace.a 00:02:11.566 SO libspdk_trace.so.9.0 00:02:11.566 SYMLINK libspdk_trace.so 00:02:11.824 LIB libspdk_sock.a 00:02:11.824 CC lib/thread/thread.o 00:02:11.824 CC lib/thread/iobuf.o 00:02:11.824 SO libspdk_sock.so.8.0 00:02:11.824 SYMLINK libspdk_sock.so 00:02:11.824 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:11.824 CC lib/nvme/nvme_ctrlr.o 00:02:11.824 CC lib/nvme/nvme_fabric.o 00:02:11.824 CC lib/nvme/nvme_ns_cmd.o 00:02:11.824 CC lib/nvme/nvme_ns.o 00:02:11.824 CC lib/nvme/nvme_pcie_common.o 00:02:11.824 CC lib/nvme/nvme_pcie.o 00:02:11.824 CC lib/nvme/nvme_qpair.o 00:02:11.824 CC lib/nvme/nvme.o 00:02:11.824 CC lib/nvme/nvme_quirks.o 00:02:11.824 CC lib/nvme/nvme_transport.o 00:02:11.824 CC lib/nvme/nvme_discovery.o 00:02:11.824 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:11.824 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:11.824 CC lib/nvme/nvme_tcp.o 00:02:11.824 CC lib/nvme/nvme_opal.o 00:02:11.824 CC lib/nvme/nvme_io_msg.o 00:02:11.824 CC lib/nvme/nvme_poll_group.o 00:02:11.824 CC lib/nvme/nvme_zns.o 00:02:11.824 CC lib/nvme/nvme_cuse.o 00:02:11.824 CC lib/nvme/nvme_vfio_user.o 00:02:11.824 CC lib/nvme/nvme_rdma.o 00:02:12.083 LIB libspdk_env_dpdk.a 00:02:12.083 SO libspdk_env_dpdk.so.13.0 00:02:12.342 SYMLINK libspdk_env_dpdk.so 00:02:13.277 LIB libspdk_thread.a 00:02:13.277 SO libspdk_thread.so.9.0 00:02:13.535 SYMLINK libspdk_thread.so 00:02:13.535 CC lib/init/json_config.o 00:02:13.535 CC lib/virtio/virtio.o 00:02:13.535 CC lib/blob/blobstore.o 00:02:13.535 CC lib/accel/accel.o 00:02:13.535 CC lib/blob/request.o 00:02:13.535 CC lib/accel/accel_rpc.o 00:02:13.535 CC lib/init/subsystem.o 00:02:13.535 CC lib/virtio/virtio_vhost_user.o 00:02:13.535 CC lib/blob/zeroes.o 00:02:13.535 CC lib/accel/accel_sw.o 00:02:13.535 CC lib/virtio/virtio_vfio_user.o 00:02:13.535 CC lib/blob/blob_bs_dev.o 00:02:13.535 CC lib/init/subsystem_rpc.o 00:02:13.535 CC lib/virtio/virtio_pci.o 00:02:13.535 CC lib/init/rpc.o 00:02:13.794 LIB libspdk_init.a 00:02:13.794 SO libspdk_init.so.4.0 00:02:13.794 SYMLINK libspdk_init.so 00:02:13.794 LIB libspdk_virtio.a 00:02:13.794 SO libspdk_virtio.so.6.0 00:02:14.052 SYMLINK libspdk_virtio.so 00:02:14.052 CC lib/event/app.o 00:02:14.052 CC lib/event/reactor.o 00:02:14.052 CC lib/event/log_rpc.o 00:02:14.052 CC lib/event/app_rpc.o 00:02:14.052 CC lib/event/scheduler_static.o 00:02:14.310 LIB libspdk_nvme.a 00:02:14.310 SO libspdk_nvme.so.12.0 00:02:14.310 LIB libspdk_event.a 00:02:14.310 SO libspdk_event.so.12.0 00:02:14.567 SYMLINK libspdk_event.so 00:02:14.567 SYMLINK libspdk_nvme.so 00:02:14.567 LIB libspdk_accel.a 00:02:14.567 SO libspdk_accel.so.14.0 00:02:14.567 SYMLINK libspdk_accel.so 00:02:14.824 CC lib/bdev/bdev.o 00:02:14.824 CC lib/bdev/bdev_rpc.o 00:02:14.824 CC lib/bdev/bdev_zone.o 00:02:14.824 CC lib/bdev/part.o 00:02:14.824 CC lib/bdev/scsi_nvme.o 00:02:16.725 LIB libspdk_blob.a 00:02:16.725 SO libspdk_blob.so.10.1 00:02:16.725 SYMLINK libspdk_blob.so 00:02:16.725 CC lib/blobfs/blobfs.o 00:02:16.725 CC lib/blobfs/tree.o 00:02:16.725 CC lib/lvol/lvol.o 00:02:17.290 LIB libspdk_blobfs.a 00:02:17.290 LIB libspdk_bdev.a 00:02:17.290 SO libspdk_blobfs.so.9.0 00:02:17.290 SO libspdk_bdev.so.14.0 00:02:17.290 LIB libspdk_lvol.a 00:02:17.552 SO libspdk_lvol.so.9.1 00:02:17.552 SYMLINK libspdk_blobfs.so 00:02:17.552 SYMLINK libspdk_bdev.so 00:02:17.552 SYMLINK libspdk_lvol.so 00:02:17.552 CC lib/ublk/ublk.o 00:02:17.552 CC lib/scsi/dev.o 00:02:17.552 CC lib/nvmf/ctrlr.o 00:02:17.552 CC lib/nbd/nbd.o 00:02:17.552 CC lib/ftl/ftl_core.o 00:02:17.552 CC lib/scsi/lun.o 00:02:17.552 CC lib/ublk/ublk_rpc.o 00:02:17.552 CC lib/nvmf/ctrlr_discovery.o 00:02:17.552 CC lib/nbd/nbd_rpc.o 00:02:17.552 CC lib/ftl/ftl_init.o 00:02:17.552 CC lib/scsi/port.o 00:02:17.552 CC lib/nvmf/ctrlr_bdev.o 00:02:17.552 CC lib/ftl/ftl_layout.o 00:02:17.552 CC lib/scsi/scsi.o 00:02:17.552 CC lib/ftl/ftl_debug.o 00:02:17.552 CC lib/nvmf/subsystem.o 00:02:17.552 CC lib/scsi/scsi_bdev.o 00:02:17.552 CC lib/ftl/ftl_io.o 00:02:17.552 CC lib/nvmf/nvmf.o 00:02:17.552 CC lib/scsi/scsi_pr.o 00:02:17.552 CC lib/ftl/ftl_sb.o 00:02:17.552 CC lib/nvmf/nvmf_rpc.o 00:02:17.552 CC lib/scsi/scsi_rpc.o 00:02:17.552 CC lib/nvmf/transport.o 00:02:17.552 CC lib/nvmf/tcp.o 00:02:17.552 CC lib/ftl/ftl_l2p.o 00:02:17.552 CC lib/scsi/task.o 00:02:17.552 CC lib/ftl/ftl_l2p_flat.o 00:02:17.552 CC lib/ftl/ftl_nv_cache.o 00:02:17.552 CC lib/nvmf/rdma.o 00:02:17.552 CC lib/ftl/ftl_band.o 00:02:17.552 CC lib/ftl/ftl_band_ops.o 00:02:17.552 CC lib/ftl/ftl_writer.o 00:02:17.552 CC lib/ftl/ftl_rq.o 00:02:17.552 CC lib/ftl/ftl_reloc.o 00:02:17.552 CC lib/ftl/ftl_l2p_cache.o 00:02:17.552 CC lib/ftl/ftl_p2l.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:17.552 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:17.815 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:17.815 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:17.815 CC lib/ftl/utils/ftl_conf.o 00:02:18.075 CC lib/ftl/utils/ftl_md.o 00:02:18.075 CC lib/ftl/utils/ftl_mempool.o 00:02:18.075 CC lib/ftl/utils/ftl_bitmap.o 00:02:18.075 CC lib/ftl/utils/ftl_property.o 00:02:18.075 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:18.075 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:18.075 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:18.075 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:18.075 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:18.075 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:18.075 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:18.075 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:18.075 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:18.075 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:18.075 CC lib/ftl/base/ftl_base_dev.o 00:02:18.075 CC lib/ftl/base/ftl_base_bdev.o 00:02:18.075 CC lib/ftl/ftl_trace.o 00:02:18.333 LIB libspdk_nbd.a 00:02:18.333 SO libspdk_nbd.so.6.0 00:02:18.333 LIB libspdk_scsi.a 00:02:18.333 SYMLINK libspdk_nbd.so 00:02:18.333 SO libspdk_scsi.so.8.0 00:02:18.592 LIB libspdk_ublk.a 00:02:18.592 SO libspdk_ublk.so.2.0 00:02:18.592 SYMLINK libspdk_scsi.so 00:02:18.592 SYMLINK libspdk_ublk.so 00:02:18.592 CC lib/vhost/vhost.o 00:02:18.592 CC lib/iscsi/conn.o 00:02:18.592 CC lib/iscsi/init_grp.o 00:02:18.592 CC lib/vhost/vhost_rpc.o 00:02:18.592 CC lib/iscsi/iscsi.o 00:02:18.592 CC lib/vhost/vhost_scsi.o 00:02:18.592 CC lib/iscsi/md5.o 00:02:18.592 CC lib/vhost/vhost_blk.o 00:02:18.592 CC lib/iscsi/param.o 00:02:18.592 CC lib/iscsi/portal_grp.o 00:02:18.592 CC lib/vhost/rte_vhost_user.o 00:02:18.592 CC lib/iscsi/tgt_node.o 00:02:18.592 CC lib/iscsi/iscsi_subsystem.o 00:02:18.592 CC lib/iscsi/iscsi_rpc.o 00:02:18.592 CC lib/iscsi/task.o 00:02:18.850 LIB libspdk_ftl.a 00:02:19.108 SO libspdk_ftl.so.8.0 00:02:19.365 SYMLINK libspdk_ftl.so 00:02:19.932 LIB libspdk_vhost.a 00:02:19.932 SO libspdk_vhost.so.7.1 00:02:19.932 SYMLINK libspdk_vhost.so 00:02:20.190 LIB libspdk_iscsi.a 00:02:20.190 LIB libspdk_nvmf.a 00:02:20.190 SO libspdk_iscsi.so.7.0 00:02:20.190 SO libspdk_nvmf.so.17.0 00:02:20.190 SYMLINK libspdk_iscsi.so 00:02:20.190 SYMLINK libspdk_nvmf.so 00:02:20.449 CC module/env_dpdk/env_dpdk_rpc.o 00:02:20.449 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:20.449 CC module/accel/error/accel_error.o 00:02:20.449 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:20.449 CC module/sock/posix/posix.o 00:02:20.449 CC module/blob/bdev/blob_bdev.o 00:02:20.449 CC module/accel/ioat/accel_ioat.o 00:02:20.449 CC module/accel/error/accel_error_rpc.o 00:02:20.449 CC module/accel/dsa/accel_dsa.o 00:02:20.449 CC module/accel/ioat/accel_ioat_rpc.o 00:02:20.449 CC module/accel/iaa/accel_iaa.o 00:02:20.449 CC module/scheduler/gscheduler/gscheduler.o 00:02:20.449 CC module/accel/dsa/accel_dsa_rpc.o 00:02:20.449 CC module/accel/iaa/accel_iaa_rpc.o 00:02:20.707 LIB libspdk_env_dpdk_rpc.a 00:02:20.707 SO libspdk_env_dpdk_rpc.so.5.0 00:02:20.707 SYMLINK libspdk_env_dpdk_rpc.so 00:02:20.707 LIB libspdk_scheduler_gscheduler.a 00:02:20.707 LIB libspdk_scheduler_dpdk_governor.a 00:02:20.707 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:20.707 SO libspdk_scheduler_gscheduler.so.3.0 00:02:20.707 LIB libspdk_accel_error.a 00:02:20.707 LIB libspdk_accel_ioat.a 00:02:20.707 LIB libspdk_scheduler_dynamic.a 00:02:20.707 LIB libspdk_accel_iaa.a 00:02:20.707 SO libspdk_accel_error.so.1.0 00:02:20.707 SO libspdk_accel_ioat.so.5.0 00:02:20.707 SO libspdk_scheduler_dynamic.so.3.0 00:02:20.707 SYMLINK libspdk_scheduler_gscheduler.so 00:02:20.707 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:20.707 SO libspdk_accel_iaa.so.2.0 00:02:20.707 LIB libspdk_accel_dsa.a 00:02:20.707 SYMLINK libspdk_accel_error.so 00:02:20.707 SYMLINK libspdk_scheduler_dynamic.so 00:02:20.707 SYMLINK libspdk_accel_ioat.so 00:02:20.707 SO libspdk_accel_dsa.so.4.0 00:02:20.707 LIB libspdk_blob_bdev.a 00:02:20.707 SYMLINK libspdk_accel_iaa.so 00:02:20.707 SO libspdk_blob_bdev.so.10.1 00:02:20.973 SYMLINK libspdk_accel_dsa.so 00:02:20.973 SYMLINK libspdk_blob_bdev.so 00:02:20.973 CC module/bdev/lvol/vbdev_lvol.o 00:02:20.973 CC module/bdev/malloc/bdev_malloc.o 00:02:20.973 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:20.973 CC module/bdev/delay/vbdev_delay.o 00:02:20.973 CC module/bdev/error/vbdev_error.o 00:02:20.973 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:20.973 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:20.973 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:20.973 CC module/bdev/error/vbdev_error_rpc.o 00:02:20.973 CC module/bdev/passthru/vbdev_passthru.o 00:02:20.973 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:20.973 CC module/bdev/null/bdev_null.o 00:02:20.973 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:20.973 CC module/bdev/null/bdev_null_rpc.o 00:02:20.973 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:20.973 CC module/bdev/nvme/bdev_nvme.o 00:02:20.973 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:20.973 CC module/bdev/gpt/gpt.o 00:02:20.973 CC module/bdev/split/vbdev_split.o 00:02:20.973 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:20.973 CC module/bdev/ftl/bdev_ftl.o 00:02:20.973 CC module/bdev/aio/bdev_aio.o 00:02:20.973 CC module/bdev/raid/bdev_raid.o 00:02:20.973 CC module/bdev/nvme/nvme_rpc.o 00:02:20.973 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:20.973 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:20.973 CC module/bdev/gpt/vbdev_gpt.o 00:02:20.973 CC module/bdev/iscsi/bdev_iscsi.o 00:02:20.973 CC module/bdev/split/vbdev_split_rpc.o 00:02:20.973 CC module/bdev/raid/bdev_raid_rpc.o 00:02:20.973 CC module/bdev/nvme/bdev_mdns_client.o 00:02:20.973 CC module/bdev/aio/bdev_aio_rpc.o 00:02:20.973 CC module/bdev/raid/bdev_raid_sb.o 00:02:20.973 CC module/bdev/nvme/vbdev_opal.o 00:02:20.973 CC module/bdev/raid/raid0.o 00:02:20.973 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:20.973 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:20.973 CC module/bdev/raid/raid1.o 00:02:20.973 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:20.973 CC module/bdev/raid/concat.o 00:02:20.973 CC module/blobfs/bdev/blobfs_bdev.o 00:02:20.973 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:21.540 LIB libspdk_sock_posix.a 00:02:21.540 SO libspdk_sock_posix.so.5.0 00:02:21.540 LIB libspdk_blobfs_bdev.a 00:02:21.540 SO libspdk_blobfs_bdev.so.5.0 00:02:21.540 LIB libspdk_bdev_split.a 00:02:21.540 LIB libspdk_bdev_malloc.a 00:02:21.540 SYMLINK libspdk_sock_posix.so 00:02:21.540 SO libspdk_bdev_split.so.5.0 00:02:21.540 SYMLINK libspdk_blobfs_bdev.so 00:02:21.540 SO libspdk_bdev_malloc.so.5.0 00:02:21.540 LIB libspdk_bdev_error.a 00:02:21.540 LIB libspdk_bdev_passthru.a 00:02:21.540 LIB libspdk_bdev_null.a 00:02:21.540 SO libspdk_bdev_error.so.5.0 00:02:21.540 SYMLINK libspdk_bdev_split.so 00:02:21.540 SO libspdk_bdev_passthru.so.5.0 00:02:21.540 LIB libspdk_bdev_gpt.a 00:02:21.540 SYMLINK libspdk_bdev_malloc.so 00:02:21.540 SO libspdk_bdev_null.so.5.0 00:02:21.540 LIB libspdk_bdev_ftl.a 00:02:21.540 SO libspdk_bdev_gpt.so.5.0 00:02:21.540 LIB libspdk_bdev_iscsi.a 00:02:21.540 SYMLINK libspdk_bdev_error.so 00:02:21.540 SO libspdk_bdev_ftl.so.5.0 00:02:21.540 SYMLINK libspdk_bdev_passthru.so 00:02:21.540 LIB libspdk_bdev_zone_block.a 00:02:21.540 LIB libspdk_bdev_aio.a 00:02:21.540 SYMLINK libspdk_bdev_null.so 00:02:21.540 SO libspdk_bdev_iscsi.so.5.0 00:02:21.540 SYMLINK libspdk_bdev_gpt.so 00:02:21.540 SO libspdk_bdev_zone_block.so.5.0 00:02:21.540 SO libspdk_bdev_aio.so.5.0 00:02:21.540 SYMLINK libspdk_bdev_ftl.so 00:02:21.540 LIB libspdk_bdev_delay.a 00:02:21.540 SYMLINK libspdk_bdev_iscsi.so 00:02:21.540 SO libspdk_bdev_delay.so.5.0 00:02:21.798 SYMLINK libspdk_bdev_zone_block.so 00:02:21.798 SYMLINK libspdk_bdev_aio.so 00:02:21.798 SYMLINK libspdk_bdev_delay.so 00:02:21.798 LIB libspdk_bdev_lvol.a 00:02:21.798 SO libspdk_bdev_lvol.so.5.0 00:02:21.798 LIB libspdk_bdev_virtio.a 00:02:21.798 SYMLINK libspdk_bdev_lvol.so 00:02:21.798 SO libspdk_bdev_virtio.so.5.0 00:02:21.798 SYMLINK libspdk_bdev_virtio.so 00:02:22.056 LIB libspdk_bdev_raid.a 00:02:22.314 SO libspdk_bdev_raid.so.5.0 00:02:22.314 SYMLINK libspdk_bdev_raid.so 00:02:23.249 LIB libspdk_bdev_nvme.a 00:02:23.249 SO libspdk_bdev_nvme.so.6.0 00:02:23.507 SYMLINK libspdk_bdev_nvme.so 00:02:23.766 CC module/event/subsystems/iobuf/iobuf.o 00:02:23.766 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:23.766 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:23.766 CC module/event/subsystems/sock/sock.o 00:02:23.766 CC module/event/subsystems/vmd/vmd.o 00:02:23.766 CC module/event/subsystems/scheduler/scheduler.o 00:02:23.766 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:23.766 LIB libspdk_event_sock.a 00:02:23.766 LIB libspdk_event_vhost_blk.a 00:02:23.766 LIB libspdk_event_vmd.a 00:02:23.766 LIB libspdk_event_scheduler.a 00:02:23.766 LIB libspdk_event_iobuf.a 00:02:23.766 SO libspdk_event_sock.so.4.0 00:02:23.766 SO libspdk_event_vhost_blk.so.2.0 00:02:23.766 SO libspdk_event_scheduler.so.3.0 00:02:23.766 SO libspdk_event_vmd.so.5.0 00:02:23.766 SO libspdk_event_iobuf.so.2.0 00:02:23.766 SYMLINK libspdk_event_vhost_blk.so 00:02:23.766 SYMLINK libspdk_event_sock.so 00:02:23.766 SYMLINK libspdk_event_scheduler.so 00:02:24.024 SYMLINK libspdk_event_vmd.so 00:02:24.024 SYMLINK libspdk_event_iobuf.so 00:02:24.024 CC module/event/subsystems/accel/accel.o 00:02:24.282 LIB libspdk_event_accel.a 00:02:24.282 SO libspdk_event_accel.so.5.0 00:02:24.282 SYMLINK libspdk_event_accel.so 00:02:24.282 CC module/event/subsystems/bdev/bdev.o 00:02:24.539 LIB libspdk_event_bdev.a 00:02:24.539 SO libspdk_event_bdev.so.5.0 00:02:24.539 SYMLINK libspdk_event_bdev.so 00:02:24.796 CC module/event/subsystems/scsi/scsi.o 00:02:24.796 CC module/event/subsystems/nbd/nbd.o 00:02:24.796 CC module/event/subsystems/ublk/ublk.o 00:02:24.796 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:24.796 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:24.796 LIB libspdk_event_nbd.a 00:02:24.796 LIB libspdk_event_ublk.a 00:02:24.796 LIB libspdk_event_scsi.a 00:02:24.796 SO libspdk_event_nbd.so.5.0 00:02:24.796 SO libspdk_event_ublk.so.2.0 00:02:24.796 SO libspdk_event_scsi.so.5.0 00:02:24.796 SYMLINK libspdk_event_nbd.so 00:02:24.796 SYMLINK libspdk_event_ublk.so 00:02:24.796 SYMLINK libspdk_event_scsi.so 00:02:25.055 LIB libspdk_event_nvmf.a 00:02:25.055 SO libspdk_event_nvmf.so.5.0 00:02:25.055 SYMLINK libspdk_event_nvmf.so 00:02:25.055 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:25.055 CC module/event/subsystems/iscsi/iscsi.o 00:02:25.055 LIB libspdk_event_vhost_scsi.a 00:02:25.314 SO libspdk_event_vhost_scsi.so.2.0 00:02:25.314 LIB libspdk_event_iscsi.a 00:02:25.314 SYMLINK libspdk_event_vhost_scsi.so 00:02:25.314 SO libspdk_event_iscsi.so.5.0 00:02:25.314 SYMLINK libspdk_event_iscsi.so 00:02:25.314 SO libspdk.so.5.0 00:02:25.314 SYMLINK libspdk.so 00:02:25.581 CC app/trace_record/trace_record.o 00:02:25.581 CXX app/trace/trace.o 00:02:25.581 CC app/spdk_lspci/spdk_lspci.o 00:02:25.581 CC app/spdk_nvme_discover/discovery_aer.o 00:02:25.581 CC app/spdk_nvme_perf/perf.o 00:02:25.581 CC app/spdk_nvme_identify/identify.o 00:02:25.581 CC app/spdk_top/spdk_top.o 00:02:25.581 TEST_HEADER include/spdk/accel.h 00:02:25.581 TEST_HEADER include/spdk/accel_module.h 00:02:25.581 CC test/rpc_client/rpc_client_test.o 00:02:25.581 TEST_HEADER include/spdk/assert.h 00:02:25.581 TEST_HEADER include/spdk/barrier.h 00:02:25.581 TEST_HEADER include/spdk/base64.h 00:02:25.581 TEST_HEADER include/spdk/bdev.h 00:02:25.581 TEST_HEADER include/spdk/bdev_module.h 00:02:25.581 TEST_HEADER include/spdk/bdev_zone.h 00:02:25.581 TEST_HEADER include/spdk/bit_array.h 00:02:25.581 TEST_HEADER include/spdk/bit_pool.h 00:02:25.581 TEST_HEADER include/spdk/blob_bdev.h 00:02:25.581 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:25.581 TEST_HEADER include/spdk/blobfs.h 00:02:25.581 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:25.581 TEST_HEADER include/spdk/blob.h 00:02:25.581 CC app/spdk_dd/spdk_dd.o 00:02:25.581 TEST_HEADER include/spdk/conf.h 00:02:25.581 CC app/nvmf_tgt/nvmf_main.o 00:02:25.581 TEST_HEADER include/spdk/config.h 00:02:25.581 TEST_HEADER include/spdk/cpuset.h 00:02:25.581 CC app/iscsi_tgt/iscsi_tgt.o 00:02:25.581 TEST_HEADER include/spdk/crc16.h 00:02:25.581 CC examples/vmd/lsvmd/lsvmd.o 00:02:25.581 TEST_HEADER include/spdk/crc32.h 00:02:25.581 CC examples/idxd/perf/perf.o 00:02:25.581 CC app/vhost/vhost.o 00:02:25.581 CC examples/vmd/led/led.o 00:02:25.581 TEST_HEADER include/spdk/crc64.h 00:02:25.581 CC examples/nvme/reconnect/reconnect.o 00:02:25.581 CC examples/ioat/perf/perf.o 00:02:25.581 CC examples/nvme/hotplug/hotplug.o 00:02:25.581 CC examples/util/zipf/zipf.o 00:02:25.581 TEST_HEADER include/spdk/dif.h 00:02:25.581 CC examples/ioat/verify/verify.o 00:02:25.581 CC examples/nvme/hello_world/hello_world.o 00:02:25.581 TEST_HEADER include/spdk/dma.h 00:02:25.581 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:25.581 TEST_HEADER include/spdk/endian.h 00:02:25.581 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:25.581 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:25.581 TEST_HEADER include/spdk/env_dpdk.h 00:02:25.581 CC examples/nvme/abort/abort.o 00:02:25.581 TEST_HEADER include/spdk/env.h 00:02:25.581 CC examples/sock/hello_world/hello_sock.o 00:02:25.581 CC test/thread/poller_perf/poller_perf.o 00:02:25.581 TEST_HEADER include/spdk/event.h 00:02:25.581 TEST_HEADER include/spdk/fd_group.h 00:02:25.581 CC test/event/event_perf/event_perf.o 00:02:25.581 CC test/nvme/aer/aer.o 00:02:25.581 CC examples/nvme/arbitration/arbitration.o 00:02:25.581 CC examples/accel/perf/accel_perf.o 00:02:25.581 CC app/fio/nvme/fio_plugin.o 00:02:25.581 TEST_HEADER include/spdk/fd.h 00:02:25.581 TEST_HEADER include/spdk/file.h 00:02:25.581 TEST_HEADER include/spdk/ftl.h 00:02:25.581 TEST_HEADER include/spdk/gpt_spec.h 00:02:25.581 CC app/spdk_tgt/spdk_tgt.o 00:02:25.581 TEST_HEADER include/spdk/hexlify.h 00:02:25.581 TEST_HEADER include/spdk/histogram_data.h 00:02:25.581 TEST_HEADER include/spdk/idxd.h 00:02:25.581 TEST_HEADER include/spdk/idxd_spec.h 00:02:25.581 TEST_HEADER include/spdk/init.h 00:02:25.581 CC examples/blob/cli/blobcli.o 00:02:25.581 TEST_HEADER include/spdk/ioat.h 00:02:25.581 CC examples/blob/hello_world/hello_blob.o 00:02:25.581 TEST_HEADER include/spdk/ioat_spec.h 00:02:25.581 CC examples/thread/thread/thread_ex.o 00:02:25.582 CC examples/bdev/hello_world/hello_bdev.o 00:02:25.582 TEST_HEADER include/spdk/iscsi_spec.h 00:02:25.582 CC examples/bdev/bdevperf/bdevperf.o 00:02:25.582 TEST_HEADER include/spdk/json.h 00:02:25.582 TEST_HEADER include/spdk/jsonrpc.h 00:02:25.582 CC test/dma/test_dma/test_dma.o 00:02:25.582 TEST_HEADER include/spdk/likely.h 00:02:25.582 CC test/blobfs/mkfs/mkfs.o 00:02:25.582 CC test/bdev/bdevio/bdevio.o 00:02:25.582 TEST_HEADER include/spdk/log.h 00:02:25.582 CC test/app/bdev_svc/bdev_svc.o 00:02:25.582 TEST_HEADER include/spdk/lvol.h 00:02:25.582 CC examples/nvmf/nvmf/nvmf.o 00:02:25.582 TEST_HEADER include/spdk/memory.h 00:02:25.582 TEST_HEADER include/spdk/mmio.h 00:02:25.582 CC test/accel/dif/dif.o 00:02:25.582 TEST_HEADER include/spdk/nbd.h 00:02:25.582 TEST_HEADER include/spdk/notify.h 00:02:25.582 TEST_HEADER include/spdk/nvme.h 00:02:25.844 TEST_HEADER include/spdk/nvme_intel.h 00:02:25.844 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:25.844 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:25.844 TEST_HEADER include/spdk/nvme_spec.h 00:02:25.844 TEST_HEADER include/spdk/nvme_zns.h 00:02:25.844 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:25.844 CC test/env/mem_callbacks/mem_callbacks.o 00:02:25.844 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:25.844 CC test/lvol/esnap/esnap.o 00:02:25.844 TEST_HEADER include/spdk/nvmf.h 00:02:25.844 TEST_HEADER include/spdk/nvmf_spec.h 00:02:25.844 TEST_HEADER include/spdk/nvmf_transport.h 00:02:25.844 TEST_HEADER include/spdk/opal.h 00:02:25.844 TEST_HEADER include/spdk/opal_spec.h 00:02:25.844 TEST_HEADER include/spdk/pci_ids.h 00:02:25.844 TEST_HEADER include/spdk/pipe.h 00:02:25.844 TEST_HEADER include/spdk/queue.h 00:02:25.844 TEST_HEADER include/spdk/reduce.h 00:02:25.844 TEST_HEADER include/spdk/rpc.h 00:02:25.844 TEST_HEADER include/spdk/scheduler.h 00:02:25.844 TEST_HEADER include/spdk/scsi.h 00:02:25.844 TEST_HEADER include/spdk/scsi_spec.h 00:02:25.844 LINK spdk_lspci 00:02:25.844 TEST_HEADER include/spdk/sock.h 00:02:25.844 TEST_HEADER include/spdk/stdinc.h 00:02:25.844 TEST_HEADER include/spdk/string.h 00:02:25.844 TEST_HEADER include/spdk/thread.h 00:02:25.844 TEST_HEADER include/spdk/trace.h 00:02:25.844 TEST_HEADER include/spdk/trace_parser.h 00:02:25.844 TEST_HEADER include/spdk/tree.h 00:02:25.844 TEST_HEADER include/spdk/ublk.h 00:02:25.844 TEST_HEADER include/spdk/util.h 00:02:25.844 TEST_HEADER include/spdk/uuid.h 00:02:25.844 TEST_HEADER include/spdk/version.h 00:02:25.844 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:25.844 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:25.844 TEST_HEADER include/spdk/vhost.h 00:02:25.844 TEST_HEADER include/spdk/vmd.h 00:02:25.844 TEST_HEADER include/spdk/xor.h 00:02:25.844 TEST_HEADER include/spdk/zipf.h 00:02:25.844 CXX test/cpp_headers/accel.o 00:02:25.844 LINK lsvmd 00:02:25.844 LINK rpc_client_test 00:02:25.844 LINK led 00:02:25.844 LINK event_perf 00:02:25.844 LINK spdk_nvme_discover 00:02:25.844 LINK poller_perf 00:02:25.844 LINK zipf 00:02:25.844 LINK interrupt_tgt 00:02:25.844 LINK nvmf_tgt 00:02:25.844 LINK pmr_persistence 00:02:25.844 LINK vhost 00:02:26.105 LINK spdk_trace_record 00:02:26.105 LINK iscsi_tgt 00:02:26.105 LINK cmb_copy 00:02:26.105 LINK verify 00:02:26.105 LINK bdev_svc 00:02:26.105 LINK ioat_perf 00:02:26.105 LINK spdk_tgt 00:02:26.105 LINK hello_world 00:02:26.105 LINK hotplug 00:02:26.105 LINK mkfs 00:02:26.105 LINK hello_sock 00:02:26.105 LINK hello_blob 00:02:26.105 LINK hello_bdev 00:02:26.105 LINK thread 00:02:26.105 CC test/env/vtophys/vtophys.o 00:02:26.105 LINK aer 00:02:26.105 CXX test/cpp_headers/accel_module.o 00:02:26.105 CXX test/cpp_headers/assert.o 00:02:26.369 LINK reconnect 00:02:26.369 LINK idxd_perf 00:02:26.369 LINK nvmf 00:02:26.369 LINK spdk_dd 00:02:26.369 LINK arbitration 00:02:26.369 CC test/event/reactor/reactor.o 00:02:26.369 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:26.369 CXX test/cpp_headers/barrier.o 00:02:26.369 CC test/event/reactor_perf/reactor_perf.o 00:02:26.369 LINK abort 00:02:26.369 LINK spdk_trace 00:02:26.369 CC test/nvme/reset/reset.o 00:02:26.369 CC test/app/histogram_perf/histogram_perf.o 00:02:26.369 CXX test/cpp_headers/base64.o 00:02:26.369 CC test/env/memory/memory_ut.o 00:02:26.369 LINK dif 00:02:26.369 LINK test_dma 00:02:26.369 LINK bdevio 00:02:26.369 CXX test/cpp_headers/bdev.o 00:02:26.369 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:26.369 CC test/event/app_repeat/app_repeat.o 00:02:26.369 CC test/nvme/sgl/sgl.o 00:02:26.369 CC app/fio/bdev/fio_plugin.o 00:02:26.369 CC test/nvme/e2edp/nvme_dp.o 00:02:26.369 LINK vtophys 00:02:26.369 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:26.369 CC test/app/jsoncat/jsoncat.o 00:02:26.369 CXX test/cpp_headers/bdev_module.o 00:02:26.369 CC test/event/scheduler/scheduler.o 00:02:26.369 LINK accel_perf 00:02:26.638 CC test/env/pci/pci_ut.o 00:02:26.638 CXX test/cpp_headers/bdev_zone.o 00:02:26.638 CC test/app/stub/stub.o 00:02:26.638 LINK nvme_manage 00:02:26.638 CXX test/cpp_headers/bit_array.o 00:02:26.638 CC test/nvme/overhead/overhead.o 00:02:26.638 LINK reactor 00:02:26.638 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:26.638 CXX test/cpp_headers/bit_pool.o 00:02:26.638 LINK reactor_perf 00:02:26.638 CC test/nvme/err_injection/err_injection.o 00:02:26.638 LINK env_dpdk_post_init 00:02:26.638 LINK spdk_nvme 00:02:26.638 LINK blobcli 00:02:26.638 LINK histogram_perf 00:02:26.638 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:26.638 CXX test/cpp_headers/blob_bdev.o 00:02:26.638 CXX test/cpp_headers/blobfs_bdev.o 00:02:26.638 CC test/nvme/startup/startup.o 00:02:26.638 CC test/nvme/reserve/reserve.o 00:02:26.638 CC test/nvme/simple_copy/simple_copy.o 00:02:26.638 CC test/nvme/connect_stress/connect_stress.o 00:02:26.638 LINK app_repeat 00:02:26.638 LINK jsoncat 00:02:26.638 CC test/nvme/boot_partition/boot_partition.o 00:02:26.638 CC test/nvme/compliance/nvme_compliance.o 00:02:26.900 CXX test/cpp_headers/blobfs.o 00:02:26.900 CXX test/cpp_headers/blob.o 00:02:26.900 CC test/nvme/fused_ordering/fused_ordering.o 00:02:26.900 CXX test/cpp_headers/conf.o 00:02:26.900 CXX test/cpp_headers/config.o 00:02:26.900 CXX test/cpp_headers/cpuset.o 00:02:26.900 CXX test/cpp_headers/crc16.o 00:02:26.900 CXX test/cpp_headers/crc32.o 00:02:26.900 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:26.900 LINK stub 00:02:26.900 LINK reset 00:02:26.900 CXX test/cpp_headers/crc64.o 00:02:26.900 CXX test/cpp_headers/dif.o 00:02:26.900 CC test/nvme/fdp/fdp.o 00:02:26.900 CXX test/cpp_headers/dma.o 00:02:26.900 CC test/nvme/cuse/cuse.o 00:02:26.900 CXX test/cpp_headers/endian.o 00:02:26.900 CXX test/cpp_headers/env_dpdk.o 00:02:26.900 CXX test/cpp_headers/env.o 00:02:26.900 CXX test/cpp_headers/event.o 00:02:26.900 LINK scheduler 00:02:26.900 LINK mem_callbacks 00:02:26.900 CXX test/cpp_headers/fd_group.o 00:02:26.900 LINK err_injection 00:02:26.900 LINK sgl 00:02:26.900 LINK startup 00:02:26.900 CXX test/cpp_headers/fd.o 00:02:26.900 LINK nvme_dp 00:02:26.900 CXX test/cpp_headers/file.o 00:02:27.161 CXX test/cpp_headers/ftl.o 00:02:27.161 LINK connect_stress 00:02:27.161 LINK reserve 00:02:27.161 CXX test/cpp_headers/gpt_spec.o 00:02:27.161 LINK spdk_nvme_perf 00:02:27.161 LINK spdk_nvme_identify 00:02:27.161 CXX test/cpp_headers/hexlify.o 00:02:27.161 LINK bdevperf 00:02:27.161 LINK boot_partition 00:02:27.161 LINK overhead 00:02:27.162 LINK simple_copy 00:02:27.162 CXX test/cpp_headers/histogram_data.o 00:02:27.162 CXX test/cpp_headers/idxd.o 00:02:27.162 LINK nvme_fuzz 00:02:27.162 CXX test/cpp_headers/idxd_spec.o 00:02:27.162 CXX test/cpp_headers/init.o 00:02:27.162 CXX test/cpp_headers/ioat.o 00:02:27.162 CXX test/cpp_headers/ioat_spec.o 00:02:27.162 CXX test/cpp_headers/iscsi_spec.o 00:02:27.162 CXX test/cpp_headers/json.o 00:02:27.162 LINK pci_ut 00:02:27.162 LINK spdk_top 00:02:27.162 CXX test/cpp_headers/jsonrpc.o 00:02:27.162 LINK doorbell_aers 00:02:27.162 CXX test/cpp_headers/likely.o 00:02:27.162 CXX test/cpp_headers/log.o 00:02:27.162 LINK fused_ordering 00:02:27.162 CXX test/cpp_headers/lvol.o 00:02:27.162 CXX test/cpp_headers/memory.o 00:02:27.162 CXX test/cpp_headers/mmio.o 00:02:27.162 CXX test/cpp_headers/nbd.o 00:02:27.424 CXX test/cpp_headers/notify.o 00:02:27.424 CXX test/cpp_headers/nvme.o 00:02:27.424 CXX test/cpp_headers/nvme_ocssd.o 00:02:27.424 CXX test/cpp_headers/nvme_intel.o 00:02:27.424 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:27.424 CXX test/cpp_headers/nvme_spec.o 00:02:27.424 CXX test/cpp_headers/nvme_zns.o 00:02:27.424 CXX test/cpp_headers/nvmf_cmd.o 00:02:27.424 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:27.424 CXX test/cpp_headers/nvmf.o 00:02:27.424 CXX test/cpp_headers/nvmf_spec.o 00:02:27.424 CXX test/cpp_headers/nvmf_transport.o 00:02:27.424 LINK nvme_compliance 00:02:27.424 CXX test/cpp_headers/opal.o 00:02:27.424 LINK spdk_bdev 00:02:27.424 CXX test/cpp_headers/opal_spec.o 00:02:27.424 LINK vhost_fuzz 00:02:27.424 CXX test/cpp_headers/pci_ids.o 00:02:27.424 CXX test/cpp_headers/pipe.o 00:02:27.424 CXX test/cpp_headers/queue.o 00:02:27.424 CXX test/cpp_headers/reduce.o 00:02:27.424 CXX test/cpp_headers/rpc.o 00:02:27.424 CXX test/cpp_headers/scheduler.o 00:02:27.424 CXX test/cpp_headers/scsi.o 00:02:27.424 CXX test/cpp_headers/scsi_spec.o 00:02:27.424 CXX test/cpp_headers/sock.o 00:02:27.424 LINK fdp 00:02:27.424 CXX test/cpp_headers/stdinc.o 00:02:27.424 CXX test/cpp_headers/string.o 00:02:27.424 CXX test/cpp_headers/thread.o 00:02:27.682 CXX test/cpp_headers/trace.o 00:02:27.682 CXX test/cpp_headers/trace_parser.o 00:02:27.682 CXX test/cpp_headers/tree.o 00:02:27.682 CXX test/cpp_headers/ublk.o 00:02:27.682 CXX test/cpp_headers/util.o 00:02:27.682 CXX test/cpp_headers/uuid.o 00:02:27.682 CXX test/cpp_headers/version.o 00:02:27.682 CXX test/cpp_headers/vfio_user_pci.o 00:02:27.682 CXX test/cpp_headers/vfio_user_spec.o 00:02:27.682 CXX test/cpp_headers/vhost.o 00:02:27.682 CXX test/cpp_headers/vmd.o 00:02:27.682 CXX test/cpp_headers/zipf.o 00:02:27.682 CXX test/cpp_headers/xor.o 00:02:27.941 LINK memory_ut 00:02:28.507 LINK cuse 00:02:28.765 LINK iscsi_fuzz 00:02:31.295 LINK esnap 00:02:31.295 00:02:31.295 real 0m46.181s 00:02:31.295 user 9m40.973s 00:02:31.295 sys 2m9.601s 00:02:31.295 07:00:34 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:31.295 07:00:34 -- common/autotest_common.sh@10 -- $ set +x 00:02:31.295 ************************************ 00:02:31.295 END TEST make 00:02:31.295 ************************************ 00:02:31.553 07:00:34 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:31.553 07:00:34 -- nvmf/common.sh@7 -- # uname -s 00:02:31.553 07:00:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:31.553 07:00:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:31.553 07:00:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:31.553 07:00:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:31.553 07:00:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:31.553 07:00:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:31.553 07:00:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:31.553 07:00:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:31.553 07:00:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:31.553 07:00:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:31.553 07:00:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:31.553 07:00:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:31.553 07:00:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:31.553 07:00:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:31.553 07:00:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:31.553 07:00:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:31.553 07:00:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:31.553 07:00:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:31.553 07:00:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:31.553 07:00:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.553 07:00:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.553 07:00:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.553 07:00:34 -- paths/export.sh@5 -- # export PATH 00:02:31.553 07:00:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:31.553 07:00:34 -- nvmf/common.sh@46 -- # : 0 00:02:31.553 07:00:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:31.553 07:00:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:31.553 07:00:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:31.553 07:00:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:31.553 07:00:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:31.553 07:00:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:31.553 07:00:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:31.553 07:00:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:31.553 07:00:34 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:31.553 07:00:34 -- spdk/autotest.sh@32 -- # uname -s 00:02:31.553 07:00:34 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:31.553 07:00:34 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:31.553 07:00:34 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:31.554 07:00:34 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:31.554 07:00:34 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:31.554 07:00:34 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:31.554 07:00:34 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:31.554 07:00:34 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:31.554 07:00:34 -- spdk/autotest.sh@48 -- # udevadm_pid=1748308 00:02:31.554 07:00:34 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:31.554 07:00:34 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.554 07:00:34 -- spdk/autotest.sh@54 -- # echo 1748310 00:02:31.554 07:00:34 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.554 07:00:34 -- spdk/autotest.sh@56 -- # echo 1748311 00:02:31.554 07:00:34 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:31.554 07:00:34 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:31.554 07:00:34 -- spdk/autotest.sh@60 -- # echo 1748312 00:02:31.554 07:00:34 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:31.554 07:00:34 -- spdk/autotest.sh@62 -- # echo 1748313 00:02:31.554 07:00:34 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:31.554 07:00:34 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:31.554 07:00:34 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:31.554 07:00:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:31.554 07:00:34 -- common/autotest_common.sh@10 -- # set +x 00:02:31.554 07:00:34 -- spdk/autotest.sh@70 -- # create_test_list 00:02:31.554 07:00:34 -- common/autotest_common.sh@736 -- # xtrace_disable 00:02:31.554 07:00:34 -- common/autotest_common.sh@10 -- # set +x 00:02:31.554 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:31.554 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:31.554 07:00:34 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:31.554 07:00:34 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.554 07:00:34 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.554 07:00:34 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:31.554 07:00:34 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:31.554 07:00:34 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:31.554 07:00:34 -- common/autotest_common.sh@1440 -- # uname 00:02:31.554 07:00:34 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:02:31.554 07:00:34 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:31.554 07:00:34 -- common/autotest_common.sh@1460 -- # uname 00:02:31.554 07:00:34 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:02:31.554 07:00:34 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:02:31.554 07:00:34 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:02:31.554 07:00:34 -- spdk/autotest.sh@83 -- # hash lcov 00:02:31.554 07:00:34 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:31.554 07:00:34 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:02:31.554 --rc lcov_branch_coverage=1 00:02:31.554 --rc lcov_function_coverage=1 00:02:31.554 --rc genhtml_branch_coverage=1 00:02:31.554 --rc genhtml_function_coverage=1 00:02:31.554 --rc genhtml_legend=1 00:02:31.554 --rc geninfo_all_blocks=1 00:02:31.554 ' 00:02:31.554 07:00:34 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:02:31.554 --rc lcov_branch_coverage=1 00:02:31.554 --rc lcov_function_coverage=1 00:02:31.554 --rc genhtml_branch_coverage=1 00:02:31.554 --rc genhtml_function_coverage=1 00:02:31.554 --rc genhtml_legend=1 00:02:31.554 --rc geninfo_all_blocks=1 00:02:31.554 ' 00:02:31.554 07:00:34 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:02:31.554 --rc lcov_branch_coverage=1 00:02:31.554 --rc lcov_function_coverage=1 00:02:31.554 --rc genhtml_branch_coverage=1 00:02:31.554 --rc genhtml_function_coverage=1 00:02:31.554 --rc genhtml_legend=1 00:02:31.554 --rc geninfo_all_blocks=1 00:02:31.554 --no-external' 00:02:31.554 07:00:34 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:02:31.554 --rc lcov_branch_coverage=1 00:02:31.554 --rc lcov_function_coverage=1 00:02:31.554 --rc genhtml_branch_coverage=1 00:02:31.554 --rc genhtml_function_coverage=1 00:02:31.554 --rc genhtml_legend=1 00:02:31.554 --rc geninfo_all_blocks=1 00:02:31.554 --no-external' 00:02:31.554 07:00:34 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:31.554 lcov: LCOV version 1.15 00:02:31.554 07:00:34 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:33.452 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:33.452 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:33.711 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:33.711 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:33.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:33.712 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:33.970 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:33.970 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:55.968 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:55.968 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:55.968 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:55.968 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:55.968 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:55.968 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:10.832 07:01:12 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:03:10.832 07:01:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:10.832 07:01:12 -- common/autotest_common.sh@10 -- # set +x 00:03:10.832 07:01:12 -- spdk/autotest.sh@102 -- # rm -f 00:03:10.832 07:01:12 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:11.399 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:11.399 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:11.399 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:11.399 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:11.399 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:11.399 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:11.399 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:11.399 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:11.399 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:11.399 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:11.399 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:11.399 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:11.399 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:11.399 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:11.399 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:11.399 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:11.399 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:11.658 07:01:14 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:03:11.658 07:01:14 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:11.658 07:01:14 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:11.658 07:01:14 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:11.658 07:01:14 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:11.658 07:01:14 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:11.658 07:01:14 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:11.658 07:01:14 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:11.658 07:01:14 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:11.658 07:01:14 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:03:11.658 07:01:14 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:03:11.658 07:01:14 -- spdk/autotest.sh@121 -- # grep -v p 00:03:11.658 07:01:14 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:11.658 07:01:14 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:03:11.658 07:01:14 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:03:11.658 07:01:14 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:11.658 07:01:14 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:11.658 No valid GPT data, bailing 00:03:11.658 07:01:14 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:11.658 07:01:14 -- scripts/common.sh@393 -- # pt= 00:03:11.658 07:01:14 -- scripts/common.sh@394 -- # return 1 00:03:11.658 07:01:14 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:11.658 1+0 records in 00:03:11.658 1+0 records out 00:03:11.658 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00177757 s, 590 MB/s 00:03:11.658 07:01:14 -- spdk/autotest.sh@129 -- # sync 00:03:11.658 07:01:14 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:11.658 07:01:14 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:11.658 07:01:14 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:13.562 07:01:16 -- spdk/autotest.sh@135 -- # uname -s 00:03:13.562 07:01:16 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:03:13.562 07:01:16 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:13.562 07:01:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:13.562 07:01:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:13.562 07:01:16 -- common/autotest_common.sh@10 -- # set +x 00:03:13.562 ************************************ 00:03:13.562 START TEST setup.sh 00:03:13.562 ************************************ 00:03:13.562 07:01:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:13.562 * Looking for test storage... 00:03:13.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:13.562 07:01:16 -- setup/test-setup.sh@10 -- # uname -s 00:03:13.562 07:01:16 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:13.562 07:01:16 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:13.562 07:01:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:13.562 07:01:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:13.562 07:01:16 -- common/autotest_common.sh@10 -- # set +x 00:03:13.562 ************************************ 00:03:13.562 START TEST acl 00:03:13.562 ************************************ 00:03:13.562 07:01:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:13.562 * Looking for test storage... 00:03:13.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:13.562 07:01:16 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:13.562 07:01:16 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:13.562 07:01:16 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:13.562 07:01:16 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:13.562 07:01:16 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:13.562 07:01:16 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:13.562 07:01:16 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:13.562 07:01:16 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:13.562 07:01:16 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:13.562 07:01:16 -- setup/acl.sh@12 -- # devs=() 00:03:13.562 07:01:16 -- setup/acl.sh@12 -- # declare -a devs 00:03:13.562 07:01:16 -- setup/acl.sh@13 -- # drivers=() 00:03:13.562 07:01:16 -- setup/acl.sh@13 -- # declare -A drivers 00:03:13.562 07:01:16 -- setup/acl.sh@51 -- # setup reset 00:03:13.562 07:01:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:13.562 07:01:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.941 07:01:17 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:14.941 07:01:17 -- setup/acl.sh@16 -- # local dev driver 00:03:14.941 07:01:17 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:14.941 07:01:17 -- setup/acl.sh@15 -- # setup output status 00:03:14.941 07:01:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.941 07:01:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:15.879 Hugepages 00:03:15.879 node hugesize free / total 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 00:03:15.879 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:15.879 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:15.879 07:01:18 -- setup/acl.sh@20 -- # continue 00:03:15.879 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:16.138 07:01:18 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:16.138 07:01:18 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:16.138 07:01:18 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:16.138 07:01:18 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:16.138 07:01:18 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:16.138 07:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:16.138 07:01:18 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:16.138 07:01:18 -- setup/acl.sh@54 -- # run_test denied denied 00:03:16.138 07:01:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:16.138 07:01:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:16.138 07:01:18 -- common/autotest_common.sh@10 -- # set +x 00:03:16.138 ************************************ 00:03:16.138 START TEST denied 00:03:16.138 ************************************ 00:03:16.138 07:01:18 -- common/autotest_common.sh@1104 -- # denied 00:03:16.138 07:01:18 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:16.138 07:01:18 -- setup/acl.sh@38 -- # setup output config 00:03:16.138 07:01:18 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:16.138 07:01:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.138 07:01:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:17.513 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:17.513 07:01:20 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:17.513 07:01:20 -- setup/acl.sh@28 -- # local dev driver 00:03:17.513 07:01:20 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:17.513 07:01:20 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:17.513 07:01:20 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:17.513 07:01:20 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:17.513 07:01:20 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:17.513 07:01:20 -- setup/acl.sh@41 -- # setup reset 00:03:17.513 07:01:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:17.513 07:01:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:20.045 00:03:20.045 real 0m3.698s 00:03:20.045 user 0m1.063s 00:03:20.045 sys 0m1.778s 00:03:20.045 07:01:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:20.045 07:01:22 -- common/autotest_common.sh@10 -- # set +x 00:03:20.045 ************************************ 00:03:20.045 END TEST denied 00:03:20.045 ************************************ 00:03:20.045 07:01:22 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:20.045 07:01:22 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:20.045 07:01:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:20.045 07:01:22 -- common/autotest_common.sh@10 -- # set +x 00:03:20.045 ************************************ 00:03:20.045 START TEST allowed 00:03:20.045 ************************************ 00:03:20.045 07:01:22 -- common/autotest_common.sh@1104 -- # allowed 00:03:20.045 07:01:22 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:20.045 07:01:22 -- setup/acl.sh@45 -- # setup output config 00:03:20.045 07:01:22 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:20.045 07:01:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.046 07:01:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:22.575 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:22.575 07:01:24 -- setup/acl.sh@47 -- # verify 00:03:22.575 07:01:24 -- setup/acl.sh@28 -- # local dev driver 00:03:22.575 07:01:24 -- setup/acl.sh@48 -- # setup reset 00:03:22.575 07:01:24 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.575 07:01:24 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:23.951 00:03:23.951 real 0m3.942s 00:03:23.951 user 0m1.082s 00:03:23.951 sys 0m1.744s 00:03:23.951 07:01:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:23.951 07:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:23.951 ************************************ 00:03:23.951 END TEST allowed 00:03:23.951 ************************************ 00:03:23.951 00:03:23.951 real 0m10.248s 00:03:23.951 user 0m3.168s 00:03:23.951 sys 0m5.196s 00:03:23.951 07:01:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:23.951 07:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:23.951 ************************************ 00:03:23.951 END TEST acl 00:03:23.951 ************************************ 00:03:23.951 07:01:26 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:23.951 07:01:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:23.951 07:01:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:23.951 07:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:23.951 ************************************ 00:03:23.951 START TEST hugepages 00:03:23.951 ************************************ 00:03:23.951 07:01:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:23.951 * Looking for test storage... 00:03:23.951 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:23.951 07:01:26 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:23.951 07:01:26 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:23.951 07:01:26 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:23.951 07:01:26 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:23.951 07:01:26 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:23.951 07:01:26 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:23.951 07:01:26 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:23.951 07:01:26 -- setup/common.sh@18 -- # local node= 00:03:23.951 07:01:26 -- setup/common.sh@19 -- # local var val 00:03:23.951 07:01:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.951 07:01:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.951 07:01:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.951 07:01:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.951 07:01:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.951 07:01:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 42563664 kB' 'MemAvailable: 46858808 kB' 'Buffers: 2708 kB' 'Cached: 10989064 kB' 'SwapCached: 0 kB' 'Active: 7363692 kB' 'Inactive: 4089760 kB' 'Active(anon): 6964264 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464948 kB' 'Mapped: 207732 kB' 'Shmem: 6502584 kB' 'KReclaimable: 450336 kB' 'Slab: 995544 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545208 kB' 'KernelStack: 12864 kB' 'PageTables: 8780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 8051156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.951 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.951 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # continue 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.952 07:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.952 07:01:26 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:23.952 07:01:26 -- setup/common.sh@33 -- # echo 2048 00:03:23.952 07:01:26 -- setup/common.sh@33 -- # return 0 00:03:23.952 07:01:26 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:23.952 07:01:26 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:23.952 07:01:26 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:23.952 07:01:26 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:23.952 07:01:26 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:23.952 07:01:26 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:23.952 07:01:26 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:23.952 07:01:26 -- setup/hugepages.sh@207 -- # get_nodes 00:03:23.952 07:01:26 -- setup/hugepages.sh@27 -- # local node 00:03:23.952 07:01:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.952 07:01:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:23.952 07:01:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.952 07:01:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.952 07:01:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.952 07:01:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.952 07:01:26 -- setup/hugepages.sh@208 -- # clear_hp 00:03:23.952 07:01:26 -- setup/hugepages.sh@37 -- # local node hp 00:03:23.952 07:01:26 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.952 07:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.952 07:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.952 07:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.952 07:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.952 07:01:26 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.952 07:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.952 07:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.952 07:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.952 07:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.953 07:01:26 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:23.953 07:01:26 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:23.953 07:01:26 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:23.953 07:01:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:23.953 07:01:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:23.953 07:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:23.953 ************************************ 00:03:23.953 START TEST default_setup 00:03:23.953 ************************************ 00:03:23.953 07:01:26 -- common/autotest_common.sh@1104 -- # default_setup 00:03:23.953 07:01:26 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:23.953 07:01:26 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:23.953 07:01:26 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:23.953 07:01:26 -- setup/hugepages.sh@51 -- # shift 00:03:23.953 07:01:26 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:23.953 07:01:26 -- setup/hugepages.sh@52 -- # local node_ids 00:03:23.953 07:01:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.953 07:01:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:23.953 07:01:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:23.953 07:01:26 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:23.953 07:01:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.953 07:01:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:23.953 07:01:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.953 07:01:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.953 07:01:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.953 07:01:26 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:23.953 07:01:26 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.953 07:01:26 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:23.953 07:01:26 -- setup/hugepages.sh@73 -- # return 0 00:03:23.953 07:01:26 -- setup/hugepages.sh@137 -- # setup output 00:03:23.953 07:01:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.953 07:01:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.324 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.324 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.325 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.325 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:26.261 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:26.261 07:01:29 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:26.261 07:01:29 -- setup/hugepages.sh@89 -- # local node 00:03:26.261 07:01:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.261 07:01:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.261 07:01:29 -- setup/hugepages.sh@92 -- # local surp 00:03:26.261 07:01:29 -- setup/hugepages.sh@93 -- # local resv 00:03:26.261 07:01:29 -- setup/hugepages.sh@94 -- # local anon 00:03:26.261 07:01:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.262 07:01:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.262 07:01:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.262 07:01:29 -- setup/common.sh@18 -- # local node= 00:03:26.262 07:01:29 -- setup/common.sh@19 -- # local var val 00:03:26.262 07:01:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.262 07:01:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.262 07:01:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.262 07:01:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.262 07:01:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.262 07:01:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44670448 kB' 'MemAvailable: 48965592 kB' 'Buffers: 2708 kB' 'Cached: 10989156 kB' 'SwapCached: 0 kB' 'Active: 7380416 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980988 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481640 kB' 'Mapped: 207776 kB' 'Shmem: 6502676 kB' 'KReclaimable: 450336 kB' 'Slab: 995616 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545280 kB' 'KernelStack: 12704 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.262 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.262 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.263 07:01:29 -- setup/common.sh@33 -- # echo 0 00:03:26.263 07:01:29 -- setup/common.sh@33 -- # return 0 00:03:26.263 07:01:29 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.263 07:01:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.263 07:01:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.263 07:01:29 -- setup/common.sh@18 -- # local node= 00:03:26.263 07:01:29 -- setup/common.sh@19 -- # local var val 00:03:26.263 07:01:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.263 07:01:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.263 07:01:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.263 07:01:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.263 07:01:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.263 07:01:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44674436 kB' 'MemAvailable: 48969580 kB' 'Buffers: 2708 kB' 'Cached: 10989164 kB' 'SwapCached: 0 kB' 'Active: 7380856 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981428 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481996 kB' 'Mapped: 207776 kB' 'Shmem: 6502684 kB' 'KReclaimable: 450336 kB' 'Slab: 995596 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545260 kB' 'KernelStack: 12720 kB' 'PageTables: 8052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072188 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.263 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.263 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.264 07:01:29 -- setup/common.sh@33 -- # echo 0 00:03:26.264 07:01:29 -- setup/common.sh@33 -- # return 0 00:03:26.264 07:01:29 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.264 07:01:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.264 07:01:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.264 07:01:29 -- setup/common.sh@18 -- # local node= 00:03:26.264 07:01:29 -- setup/common.sh@19 -- # local var val 00:03:26.264 07:01:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.264 07:01:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.264 07:01:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.264 07:01:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.264 07:01:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.264 07:01:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44674688 kB' 'MemAvailable: 48969832 kB' 'Buffers: 2708 kB' 'Cached: 10989176 kB' 'SwapCached: 0 kB' 'Active: 7380468 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981040 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481564 kB' 'Mapped: 207756 kB' 'Shmem: 6502696 kB' 'KReclaimable: 450336 kB' 'Slab: 995668 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545332 kB' 'KernelStack: 12784 kB' 'PageTables: 8204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072204 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.264 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.264 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.265 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.265 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.265 07:01:29 -- setup/common.sh@33 -- # echo 0 00:03:26.265 07:01:29 -- setup/common.sh@33 -- # return 0 00:03:26.265 07:01:29 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.265 07:01:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:26.265 nr_hugepages=1024 00:03:26.265 07:01:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.265 resv_hugepages=0 00:03:26.265 07:01:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.265 surplus_hugepages=0 00:03:26.265 07:01:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.265 anon_hugepages=0 00:03:26.265 07:01:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.265 07:01:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:26.265 07:01:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.265 07:01:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.265 07:01:29 -- setup/common.sh@18 -- # local node= 00:03:26.265 07:01:29 -- setup/common.sh@19 -- # local var val 00:03:26.265 07:01:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.265 07:01:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.265 07:01:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.265 07:01:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.266 07:01:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.266 07:01:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44674436 kB' 'MemAvailable: 48969580 kB' 'Buffers: 2708 kB' 'Cached: 10989188 kB' 'SwapCached: 0 kB' 'Active: 7380244 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980816 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481344 kB' 'Mapped: 207756 kB' 'Shmem: 6502708 kB' 'KReclaimable: 450336 kB' 'Slab: 995668 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545332 kB' 'KernelStack: 12768 kB' 'PageTables: 8148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.266 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.266 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.267 07:01:29 -- setup/common.sh@33 -- # echo 1024 00:03:26.267 07:01:29 -- setup/common.sh@33 -- # return 0 00:03:26.267 07:01:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.267 07:01:29 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.267 07:01:29 -- setup/hugepages.sh@27 -- # local node 00:03:26.267 07:01:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.267 07:01:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:26.267 07:01:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.267 07:01:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:26.267 07:01:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.267 07:01:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.267 07:01:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.267 07:01:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.267 07:01:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.267 07:01:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.267 07:01:29 -- setup/common.sh@18 -- # local node=0 00:03:26.267 07:01:29 -- setup/common.sh@19 -- # local var val 00:03:26.267 07:01:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.267 07:01:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.267 07:01:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.267 07:01:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.267 07:01:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.267 07:01:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 19262680 kB' 'MemUsed: 13563176 kB' 'SwapCached: 0 kB' 'Active: 6139304 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898436 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806464 kB' 'Mapped: 172940 kB' 'AnonPages: 199636 kB' 'Shmem: 5702012 kB' 'KernelStack: 6328 kB' 'PageTables: 3840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586820 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 317132 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.267 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.267 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # continue 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.268 07:01:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.268 07:01:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.268 07:01:29 -- setup/common.sh@33 -- # echo 0 00:03:26.268 07:01:29 -- setup/common.sh@33 -- # return 0 00:03:26.268 07:01:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.268 07:01:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.268 07:01:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.268 07:01:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.268 07:01:29 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:26.268 node0=1024 expecting 1024 00:03:26.268 07:01:29 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:26.268 00:03:26.268 real 0m2.537s 00:03:26.268 user 0m0.666s 00:03:26.268 sys 0m0.978s 00:03:26.268 07:01:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:26.268 07:01:29 -- common/autotest_common.sh@10 -- # set +x 00:03:26.268 ************************************ 00:03:26.268 END TEST default_setup 00:03:26.268 ************************************ 00:03:26.526 07:01:29 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:26.526 07:01:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:26.526 07:01:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:26.526 07:01:29 -- common/autotest_common.sh@10 -- # set +x 00:03:26.526 ************************************ 00:03:26.526 START TEST per_node_1G_alloc 00:03:26.526 ************************************ 00:03:26.526 07:01:29 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:03:26.526 07:01:29 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:26.526 07:01:29 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:26.526 07:01:29 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.526 07:01:29 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:26.526 07:01:29 -- setup/hugepages.sh@51 -- # shift 00:03:26.526 07:01:29 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:26.526 07:01:29 -- setup/hugepages.sh@52 -- # local node_ids 00:03:26.526 07:01:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.526 07:01:29 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.526 07:01:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:26.526 07:01:29 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:26.527 07:01:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.527 07:01:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.527 07:01:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.527 07:01:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.527 07:01:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.527 07:01:29 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:26.527 07:01:29 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:26.527 07:01:29 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:26.527 07:01:29 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:26.527 07:01:29 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:26.527 07:01:29 -- setup/hugepages.sh@73 -- # return 0 00:03:26.527 07:01:29 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:26.527 07:01:29 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:26.527 07:01:29 -- setup/hugepages.sh@146 -- # setup output 00:03:26.527 07:01:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.527 07:01:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:27.463 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.463 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:27.463 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.463 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.463 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.463 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.463 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.463 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.463 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.463 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:27.463 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:27.726 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:27.726 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:27.726 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:27.726 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:27.726 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:27.726 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:27.726 07:01:30 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:27.726 07:01:30 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:27.726 07:01:30 -- setup/hugepages.sh@89 -- # local node 00:03:27.726 07:01:30 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:27.726 07:01:30 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:27.726 07:01:30 -- setup/hugepages.sh@92 -- # local surp 00:03:27.726 07:01:30 -- setup/hugepages.sh@93 -- # local resv 00:03:27.726 07:01:30 -- setup/hugepages.sh@94 -- # local anon 00:03:27.726 07:01:30 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:27.726 07:01:30 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:27.726 07:01:30 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:27.726 07:01:30 -- setup/common.sh@18 -- # local node= 00:03:27.726 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.726 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.726 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.726 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.726 07:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.726 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.726 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44677768 kB' 'MemAvailable: 48972912 kB' 'Buffers: 2708 kB' 'Cached: 10989248 kB' 'SwapCached: 0 kB' 'Active: 7380608 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981180 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481660 kB' 'Mapped: 207780 kB' 'Shmem: 6502768 kB' 'KReclaimable: 450336 kB' 'Slab: 995532 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545196 kB' 'KernelStack: 12768 kB' 'PageTables: 8112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.726 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.726 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.727 07:01:30 -- setup/common.sh@33 -- # echo 0 00:03:27.727 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.727 07:01:30 -- setup/hugepages.sh@97 -- # anon=0 00:03:27.727 07:01:30 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:27.727 07:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.727 07:01:30 -- setup/common.sh@18 -- # local node= 00:03:27.727 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.727 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.727 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.727 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.727 07:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.727 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.727 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44677956 kB' 'MemAvailable: 48973100 kB' 'Buffers: 2708 kB' 'Cached: 10989248 kB' 'SwapCached: 0 kB' 'Active: 7380372 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980944 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481440 kB' 'Mapped: 207780 kB' 'Shmem: 6502768 kB' 'KReclaimable: 450336 kB' 'Slab: 995496 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545160 kB' 'KernelStack: 12720 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.727 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.727 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.728 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.728 07:01:30 -- setup/common.sh@33 -- # echo 0 00:03:27.728 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.728 07:01:30 -- setup/hugepages.sh@99 -- # surp=0 00:03:27.728 07:01:30 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:27.728 07:01:30 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:27.728 07:01:30 -- setup/common.sh@18 -- # local node= 00:03:27.728 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.728 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.728 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.728 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.728 07:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.728 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.728 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.728 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44678604 kB' 'MemAvailable: 48973748 kB' 'Buffers: 2708 kB' 'Cached: 10989248 kB' 'SwapCached: 0 kB' 'Active: 7380392 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980964 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481460 kB' 'Mapped: 207760 kB' 'Shmem: 6502768 kB' 'KReclaimable: 450336 kB' 'Slab: 995496 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545160 kB' 'KernelStack: 12720 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072420 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.729 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.729 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.730 07:01:30 -- setup/common.sh@33 -- # echo 0 00:03:27.730 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.730 07:01:30 -- setup/hugepages.sh@100 -- # resv=0 00:03:27.730 07:01:30 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:27.730 nr_hugepages=1024 00:03:27.730 07:01:30 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:27.730 resv_hugepages=0 00:03:27.730 07:01:30 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:27.730 surplus_hugepages=0 00:03:27.730 07:01:30 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:27.730 anon_hugepages=0 00:03:27.730 07:01:30 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.730 07:01:30 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:27.730 07:01:30 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:27.730 07:01:30 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:27.730 07:01:30 -- setup/common.sh@18 -- # local node= 00:03:27.730 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.730 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.730 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.730 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.730 07:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.730 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.730 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44679792 kB' 'MemAvailable: 48974936 kB' 'Buffers: 2708 kB' 'Cached: 10989276 kB' 'SwapCached: 0 kB' 'Active: 7379980 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980552 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481024 kB' 'Mapped: 207760 kB' 'Shmem: 6502796 kB' 'KReclaimable: 450336 kB' 'Slab: 995536 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545200 kB' 'KernelStack: 12816 kB' 'PageTables: 8204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072436 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.730 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.730 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.731 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.731 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.993 07:01:30 -- setup/common.sh@33 -- # echo 1024 00:03:27.993 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.993 07:01:30 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.993 07:01:30 -- setup/hugepages.sh@112 -- # get_nodes 00:03:27.993 07:01:30 -- setup/hugepages.sh@27 -- # local node 00:03:27.993 07:01:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.993 07:01:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.993 07:01:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.993 07:01:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.993 07:01:30 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:27.993 07:01:30 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:27.993 07:01:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.993 07:01:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.993 07:01:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:27.993 07:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.993 07:01:30 -- setup/common.sh@18 -- # local node=0 00:03:27.993 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.993 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.993 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.993 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:27.993 07:01:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:27.993 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.993 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20316580 kB' 'MemUsed: 12509276 kB' 'SwapCached: 0 kB' 'Active: 6139556 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898688 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806544 kB' 'Mapped: 172940 kB' 'AnonPages: 199804 kB' 'Shmem: 5702092 kB' 'KernelStack: 6344 kB' 'PageTables: 3852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586752 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 317064 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@33 -- # echo 0 00:03:27.993 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.993 07:01:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.993 07:01:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.993 07:01:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.993 07:01:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:27.993 07:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.993 07:01:30 -- setup/common.sh@18 -- # local node=1 00:03:27.993 07:01:30 -- setup/common.sh@19 -- # local var val 00:03:27.993 07:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.993 07:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.993 07:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:27.993 07:01:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:27.993 07:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.993 07:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709812 kB' 'MemFree: 24363508 kB' 'MemUsed: 3346304 kB' 'SwapCached: 0 kB' 'Active: 1240384 kB' 'Inactive: 226176 kB' 'Active(anon): 1081824 kB' 'Inactive(anon): 0 kB' 'Active(file): 158560 kB' 'Inactive(file): 226176 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1185456 kB' 'Mapped: 34820 kB' 'AnonPages: 281164 kB' 'Shmem: 800720 kB' 'KernelStack: 6472 kB' 'PageTables: 4352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 180648 kB' 'Slab: 408784 kB' 'SReclaimable: 180648 kB' 'SUnreclaim: 228136 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.993 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.993 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # continue 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.994 07:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.994 07:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.994 07:01:30 -- setup/common.sh@33 -- # echo 0 00:03:27.994 07:01:30 -- setup/common.sh@33 -- # return 0 00:03:27.994 07:01:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.994 07:01:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.994 07:01:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.994 07:01:30 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:27.994 node0=512 expecting 512 00:03:27.994 07:01:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.994 07:01:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.994 07:01:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.994 07:01:30 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:27.994 node1=512 expecting 512 00:03:27.994 07:01:30 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:27.994 00:03:27.994 real 0m1.493s 00:03:27.994 user 0m0.608s 00:03:27.994 sys 0m0.853s 00:03:27.994 07:01:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:27.994 07:01:30 -- common/autotest_common.sh@10 -- # set +x 00:03:27.994 ************************************ 00:03:27.994 END TEST per_node_1G_alloc 00:03:27.994 ************************************ 00:03:27.994 07:01:30 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:27.994 07:01:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:27.994 07:01:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:27.994 07:01:30 -- common/autotest_common.sh@10 -- # set +x 00:03:27.994 ************************************ 00:03:27.994 START TEST even_2G_alloc 00:03:27.994 ************************************ 00:03:27.994 07:01:30 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:03:27.994 07:01:30 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:27.994 07:01:30 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:27.994 07:01:30 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:27.994 07:01:30 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:27.994 07:01:30 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:27.994 07:01:30 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:27.994 07:01:30 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:27.994 07:01:30 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:27.994 07:01:30 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:27.994 07:01:30 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:27.994 07:01:30 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:27.994 07:01:30 -- setup/hugepages.sh@83 -- # : 512 00:03:27.994 07:01:30 -- setup/hugepages.sh@84 -- # : 1 00:03:27.994 07:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:27.994 07:01:30 -- setup/hugepages.sh@83 -- # : 0 00:03:27.994 07:01:30 -- setup/hugepages.sh@84 -- # : 0 00:03:27.994 07:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.994 07:01:30 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:27.994 07:01:30 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:27.994 07:01:30 -- setup/hugepages.sh@153 -- # setup output 00:03:27.994 07:01:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.994 07:01:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.995 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.995 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:28.995 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.995 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.995 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.995 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.995 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.995 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.995 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.995 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.995 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.995 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.995 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.995 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.995 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.995 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.995 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.257 07:01:32 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:29.257 07:01:32 -- setup/hugepages.sh@89 -- # local node 00:03:29.257 07:01:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.257 07:01:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.257 07:01:32 -- setup/hugepages.sh@92 -- # local surp 00:03:29.257 07:01:32 -- setup/hugepages.sh@93 -- # local resv 00:03:29.257 07:01:32 -- setup/hugepages.sh@94 -- # local anon 00:03:29.257 07:01:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.257 07:01:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.257 07:01:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.257 07:01:32 -- setup/common.sh@18 -- # local node= 00:03:29.257 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.257 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.257 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.257 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.257 07:01:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.257 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.257 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44664012 kB' 'MemAvailable: 48959156 kB' 'Buffers: 2708 kB' 'Cached: 10989332 kB' 'SwapCached: 0 kB' 'Active: 7381876 kB' 'Inactive: 4089760 kB' 'Active(anon): 6982448 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482852 kB' 'Mapped: 207912 kB' 'Shmem: 6502852 kB' 'KReclaimable: 450336 kB' 'Slab: 995884 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545548 kB' 'KernelStack: 12848 kB' 'PageTables: 8352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8074672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.257 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.257 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.258 07:01:32 -- setup/common.sh@33 -- # echo 0 00:03:29.258 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.258 07:01:32 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.258 07:01:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.258 07:01:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.258 07:01:32 -- setup/common.sh@18 -- # local node= 00:03:29.258 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.258 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.258 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.258 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.258 07:01:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.258 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.258 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44665328 kB' 'MemAvailable: 48960472 kB' 'Buffers: 2708 kB' 'Cached: 10989336 kB' 'SwapCached: 0 kB' 'Active: 7381880 kB' 'Inactive: 4089760 kB' 'Active(anon): 6982452 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482840 kB' 'Mapped: 207920 kB' 'Shmem: 6502856 kB' 'KReclaimable: 450336 kB' 'Slab: 995864 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545528 kB' 'KernelStack: 12816 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8072492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.258 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.258 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.259 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.259 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.259 07:01:32 -- setup/common.sh@33 -- # echo 0 00:03:29.259 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.259 07:01:32 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.259 07:01:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.259 07:01:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.259 07:01:32 -- setup/common.sh@18 -- # local node= 00:03:29.259 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.259 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.259 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.260 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.260 07:01:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.260 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.260 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44666396 kB' 'MemAvailable: 48961540 kB' 'Buffers: 2708 kB' 'Cached: 10989344 kB' 'SwapCached: 0 kB' 'Active: 7380852 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981424 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481744 kB' 'Mapped: 207416 kB' 'Shmem: 6502864 kB' 'KReclaimable: 450336 kB' 'Slab: 995864 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545528 kB' 'KernelStack: 12768 kB' 'PageTables: 8108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8057228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.260 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.260 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.261 07:01:32 -- setup/common.sh@33 -- # echo 0 00:03:29.261 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.261 07:01:32 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.261 07:01:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:29.261 nr_hugepages=1024 00:03:29.261 07:01:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.261 resv_hugepages=0 00:03:29.261 07:01:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.261 surplus_hugepages=0 00:03:29.261 07:01:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.261 anon_hugepages=0 00:03:29.261 07:01:32 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.261 07:01:32 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:29.261 07:01:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.261 07:01:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.261 07:01:32 -- setup/common.sh@18 -- # local node= 00:03:29.261 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.261 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.261 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.261 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.261 07:01:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.261 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.261 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44667180 kB' 'MemAvailable: 48962324 kB' 'Buffers: 2708 kB' 'Cached: 10989360 kB' 'SwapCached: 0 kB' 'Active: 7378096 kB' 'Inactive: 4089760 kB' 'Active(anon): 6978668 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478956 kB' 'Mapped: 206744 kB' 'Shmem: 6502880 kB' 'KReclaimable: 450336 kB' 'Slab: 995776 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 545440 kB' 'KernelStack: 12704 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8057240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.261 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.261 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.262 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.262 07:01:32 -- setup/common.sh@33 -- # echo 1024 00:03:29.262 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.262 07:01:32 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:29.262 07:01:32 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.262 07:01:32 -- setup/hugepages.sh@27 -- # local node 00:03:29.262 07:01:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.262 07:01:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.262 07:01:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.262 07:01:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.262 07:01:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.262 07:01:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.262 07:01:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.262 07:01:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.262 07:01:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.262 07:01:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.262 07:01:32 -- setup/common.sh@18 -- # local node=0 00:03:29.262 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.262 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.262 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.262 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.262 07:01:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.262 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.262 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.262 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20305156 kB' 'MemUsed: 12520700 kB' 'SwapCached: 0 kB' 'Active: 6139008 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898140 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806624 kB' 'Mapped: 172168 kB' 'AnonPages: 199096 kB' 'Shmem: 5702172 kB' 'KernelStack: 6280 kB' 'PageTables: 3596 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586924 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 317236 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.263 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.263 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.263 07:01:32 -- setup/common.sh@33 -- # echo 0 00:03:29.263 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.263 07:01:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.263 07:01:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.263 07:01:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.263 07:01:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.263 07:01:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.263 07:01:32 -- setup/common.sh@18 -- # local node=1 00:03:29.263 07:01:32 -- setup/common.sh@19 -- # local var val 00:03:29.263 07:01:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.263 07:01:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.263 07:01:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.263 07:01:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.522 07:01:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.522 07:01:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709812 kB' 'MemFree: 24364936 kB' 'MemUsed: 3344876 kB' 'SwapCached: 0 kB' 'Active: 1239064 kB' 'Inactive: 226176 kB' 'Active(anon): 1080504 kB' 'Inactive(anon): 0 kB' 'Active(file): 158560 kB' 'Inactive(file): 226176 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1185460 kB' 'Mapped: 34576 kB' 'AnonPages: 279824 kB' 'Shmem: 800724 kB' 'KernelStack: 6408 kB' 'PageTables: 4044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 180648 kB' 'Slab: 408844 kB' 'SReclaimable: 180648 kB' 'SUnreclaim: 228196 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.522 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.522 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # continue 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.523 07:01:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.523 07:01:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.523 07:01:32 -- setup/common.sh@33 -- # echo 0 00:03:29.523 07:01:32 -- setup/common.sh@33 -- # return 0 00:03:29.523 07:01:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.523 07:01:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.523 07:01:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.523 07:01:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.523 node0=512 expecting 512 00:03:29.523 07:01:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.523 07:01:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.523 07:01:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.523 07:01:32 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:29.523 node1=512 expecting 512 00:03:29.523 07:01:32 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:29.523 00:03:29.523 real 0m1.483s 00:03:29.523 user 0m0.596s 00:03:29.523 sys 0m0.853s 00:03:29.523 07:01:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:29.523 07:01:32 -- common/autotest_common.sh@10 -- # set +x 00:03:29.523 ************************************ 00:03:29.523 END TEST even_2G_alloc 00:03:29.523 ************************************ 00:03:29.523 07:01:32 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:29.523 07:01:32 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:29.523 07:01:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:29.523 07:01:32 -- common/autotest_common.sh@10 -- # set +x 00:03:29.523 ************************************ 00:03:29.523 START TEST odd_alloc 00:03:29.523 ************************************ 00:03:29.523 07:01:32 -- common/autotest_common.sh@1104 -- # odd_alloc 00:03:29.523 07:01:32 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:29.523 07:01:32 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:29.523 07:01:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:29.523 07:01:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:29.523 07:01:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:29.523 07:01:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.523 07:01:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:29.523 07:01:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.523 07:01:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.523 07:01:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.523 07:01:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:29.523 07:01:32 -- setup/hugepages.sh@83 -- # : 513 00:03:29.523 07:01:32 -- setup/hugepages.sh@84 -- # : 1 00:03:29.523 07:01:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:29.523 07:01:32 -- setup/hugepages.sh@83 -- # : 0 00:03:29.523 07:01:32 -- setup/hugepages.sh@84 -- # : 0 00:03:29.523 07:01:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:29.523 07:01:32 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:29.523 07:01:32 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:29.523 07:01:32 -- setup/hugepages.sh@160 -- # setup output 00:03:29.523 07:01:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.523 07:01:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:30.902 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.902 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:30.902 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.902 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.902 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.902 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.902 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.902 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.902 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.902 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:30.902 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:30.902 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:30.902 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:30.902 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:30.902 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:30.902 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:30.902 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:30.902 07:01:33 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:30.902 07:01:33 -- setup/hugepages.sh@89 -- # local node 00:03:30.902 07:01:33 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:30.902 07:01:33 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:30.902 07:01:33 -- setup/hugepages.sh@92 -- # local surp 00:03:30.902 07:01:33 -- setup/hugepages.sh@93 -- # local resv 00:03:30.902 07:01:33 -- setup/hugepages.sh@94 -- # local anon 00:03:30.902 07:01:33 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:30.902 07:01:33 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:30.902 07:01:33 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:30.902 07:01:33 -- setup/common.sh@18 -- # local node= 00:03:30.902 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.902 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.902 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.903 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.903 07:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.903 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.903 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44684852 kB' 'MemAvailable: 48979996 kB' 'Buffers: 2708 kB' 'Cached: 10989432 kB' 'SwapCached: 0 kB' 'Active: 7379148 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979720 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479936 kB' 'Mapped: 206776 kB' 'Shmem: 6502952 kB' 'KReclaimable: 450336 kB' 'Slab: 995180 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544844 kB' 'KernelStack: 12736 kB' 'PageTables: 7572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8057428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.903 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.903 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:30.904 07:01:33 -- setup/common.sh@33 -- # echo 0 00:03:30.904 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.904 07:01:33 -- setup/hugepages.sh@97 -- # anon=0 00:03:30.904 07:01:33 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:30.904 07:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.904 07:01:33 -- setup/common.sh@18 -- # local node= 00:03:30.904 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.904 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.904 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.904 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.904 07:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.904 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.904 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44685164 kB' 'MemAvailable: 48980308 kB' 'Buffers: 2708 kB' 'Cached: 10989436 kB' 'SwapCached: 0 kB' 'Active: 7378752 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979324 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479512 kB' 'Mapped: 206752 kB' 'Shmem: 6502956 kB' 'KReclaimable: 450336 kB' 'Slab: 995188 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544852 kB' 'KernelStack: 12720 kB' 'PageTables: 7484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8057440 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.904 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.904 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.905 07:01:33 -- setup/common.sh@33 -- # echo 0 00:03:30.905 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.905 07:01:33 -- setup/hugepages.sh@99 -- # surp=0 00:03:30.905 07:01:33 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:30.905 07:01:33 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:30.905 07:01:33 -- setup/common.sh@18 -- # local node= 00:03:30.905 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.905 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.905 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.905 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.905 07:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.905 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.905 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44685612 kB' 'MemAvailable: 48980756 kB' 'Buffers: 2708 kB' 'Cached: 10989444 kB' 'SwapCached: 0 kB' 'Active: 7378704 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979276 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479464 kB' 'Mapped: 206752 kB' 'Shmem: 6502964 kB' 'KReclaimable: 450336 kB' 'Slab: 995308 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544972 kB' 'KernelStack: 12752 kB' 'PageTables: 7792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8057456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.905 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.905 07:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.906 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:30.906 07:01:33 -- setup/common.sh@33 -- # echo 0 00:03:30.906 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.906 07:01:33 -- setup/hugepages.sh@100 -- # resv=0 00:03:30.906 07:01:33 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:30.906 nr_hugepages=1025 00:03:30.906 07:01:33 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:30.906 resv_hugepages=0 00:03:30.906 07:01:33 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:30.906 surplus_hugepages=0 00:03:30.906 07:01:33 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:30.906 anon_hugepages=0 00:03:30.906 07:01:33 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:30.906 07:01:33 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:30.906 07:01:33 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:30.906 07:01:33 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:30.906 07:01:33 -- setup/common.sh@18 -- # local node= 00:03:30.906 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.906 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.906 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.906 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:30.906 07:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:30.906 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.906 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.906 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44685612 kB' 'MemAvailable: 48980756 kB' 'Buffers: 2708 kB' 'Cached: 10989456 kB' 'SwapCached: 0 kB' 'Active: 7378120 kB' 'Inactive: 4089760 kB' 'Active(anon): 6978692 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478864 kB' 'Mapped: 206752 kB' 'Shmem: 6502976 kB' 'KReclaimable: 450336 kB' 'Slab: 995308 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544972 kB' 'KernelStack: 12768 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8057472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.907 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.907 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:30.908 07:01:33 -- setup/common.sh@33 -- # echo 1025 00:03:30.908 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.908 07:01:33 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:30.908 07:01:33 -- setup/hugepages.sh@112 -- # get_nodes 00:03:30.908 07:01:33 -- setup/hugepages.sh@27 -- # local node 00:03:30.908 07:01:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:30.908 07:01:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:30.908 07:01:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:30.908 07:01:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:30.908 07:01:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:30.908 07:01:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:30.908 07:01:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:30.908 07:01:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:30.908 07:01:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:30.908 07:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.908 07:01:33 -- setup/common.sh@18 -- # local node=0 00:03:30.908 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.908 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.908 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.908 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:30.908 07:01:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:30.908 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.908 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20317884 kB' 'MemUsed: 12507972 kB' 'SwapCached: 0 kB' 'Active: 6139328 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898460 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806712 kB' 'Mapped: 172172 kB' 'AnonPages: 199336 kB' 'Shmem: 5702260 kB' 'KernelStack: 6312 kB' 'PageTables: 3800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586760 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 317072 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.908 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.908 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@33 -- # echo 0 00:03:30.909 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.909 07:01:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:30.909 07:01:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:30.909 07:01:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:30.909 07:01:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:30.909 07:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:30.909 07:01:33 -- setup/common.sh@18 -- # local node=1 00:03:30.909 07:01:33 -- setup/common.sh@19 -- # local var val 00:03:30.909 07:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:30.909 07:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:30.909 07:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:30.909 07:01:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:30.909 07:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:30.909 07:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709812 kB' 'MemFree: 24367464 kB' 'MemUsed: 3342348 kB' 'SwapCached: 0 kB' 'Active: 1238908 kB' 'Inactive: 226176 kB' 'Active(anon): 1080348 kB' 'Inactive(anon): 0 kB' 'Active(file): 158560 kB' 'Inactive(file): 226176 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1185468 kB' 'Mapped: 34580 kB' 'AnonPages: 279628 kB' 'Shmem: 800732 kB' 'KernelStack: 6440 kB' 'PageTables: 3988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 180648 kB' 'Slab: 408548 kB' 'SReclaimable: 180648 kB' 'SUnreclaim: 227900 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.909 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.909 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # continue 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:30.910 07:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:30.910 07:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:30.910 07:01:33 -- setup/common.sh@33 -- # echo 0 00:03:30.910 07:01:33 -- setup/common.sh@33 -- # return 0 00:03:30.910 07:01:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:30.910 07:01:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:30.910 07:01:33 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:30.910 node0=512 expecting 513 00:03:30.910 07:01:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:30.910 07:01:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:30.910 07:01:33 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:30.910 node1=513 expecting 512 00:03:30.910 07:01:33 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:30.910 00:03:30.910 real 0m1.494s 00:03:30.910 user 0m0.614s 00:03:30.910 sys 0m0.847s 00:03:30.910 07:01:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:30.910 07:01:33 -- common/autotest_common.sh@10 -- # set +x 00:03:30.910 ************************************ 00:03:30.910 END TEST odd_alloc 00:03:30.910 ************************************ 00:03:30.910 07:01:33 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:30.910 07:01:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:30.910 07:01:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:30.910 07:01:33 -- common/autotest_common.sh@10 -- # set +x 00:03:30.910 ************************************ 00:03:30.910 START TEST custom_alloc 00:03:30.910 ************************************ 00:03:30.910 07:01:33 -- common/autotest_common.sh@1104 -- # custom_alloc 00:03:30.910 07:01:33 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:30.910 07:01:33 -- setup/hugepages.sh@169 -- # local node 00:03:30.910 07:01:33 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:30.910 07:01:33 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:30.910 07:01:33 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:30.910 07:01:33 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:30.910 07:01:33 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:30.910 07:01:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:30.910 07:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:30.910 07:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:30.910 07:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:30.910 07:01:33 -- setup/hugepages.sh@83 -- # : 256 00:03:30.910 07:01:33 -- setup/hugepages.sh@84 -- # : 1 00:03:30.910 07:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:30.910 07:01:33 -- setup/hugepages.sh@83 -- # : 0 00:03:30.910 07:01:33 -- setup/hugepages.sh@84 -- # : 0 00:03:30.910 07:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:30.910 07:01:33 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:30.910 07:01:33 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:30.910 07:01:33 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:30.910 07:01:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:30.910 07:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:30.910 07:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:30.910 07:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:30.910 07:01:33 -- setup/hugepages.sh@78 -- # return 0 00:03:30.910 07:01:33 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:30.910 07:01:33 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:30.910 07:01:33 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:30.910 07:01:33 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:30.910 07:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:30.910 07:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:30.910 07:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:30.910 07:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:30.910 07:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:30.910 07:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:30.910 07:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:30.910 07:01:33 -- setup/hugepages.sh@78 -- # return 0 00:03:30.910 07:01:33 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:30.910 07:01:33 -- setup/hugepages.sh@187 -- # setup output 00:03:30.910 07:01:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.910 07:01:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:32.289 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.289 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.289 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.289 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.289 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.289 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.289 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.289 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.290 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.290 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.290 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.290 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.290 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.290 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.290 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.290 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.290 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.290 07:01:35 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:32.290 07:01:35 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:32.290 07:01:35 -- setup/hugepages.sh@89 -- # local node 00:03:32.290 07:01:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.290 07:01:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.290 07:01:35 -- setup/hugepages.sh@92 -- # local surp 00:03:32.290 07:01:35 -- setup/hugepages.sh@93 -- # local resv 00:03:32.290 07:01:35 -- setup/hugepages.sh@94 -- # local anon 00:03:32.290 07:01:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.290 07:01:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.290 07:01:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.290 07:01:35 -- setup/common.sh@18 -- # local node= 00:03:32.290 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.290 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.290 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.290 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.290 07:01:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.290 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.290 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 43616284 kB' 'MemAvailable: 47911428 kB' 'Buffers: 2708 kB' 'Cached: 10989524 kB' 'SwapCached: 0 kB' 'Active: 7379288 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979860 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479848 kB' 'Mapped: 206820 kB' 'Shmem: 6503044 kB' 'KReclaimable: 450336 kB' 'Slab: 995160 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544824 kB' 'KernelStack: 12784 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8057792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.290 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.290 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.291 07:01:35 -- setup/common.sh@33 -- # echo 0 00:03:32.291 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.291 07:01:35 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.291 07:01:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.291 07:01:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.291 07:01:35 -- setup/common.sh@18 -- # local node= 00:03:32.291 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.291 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.291 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.291 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.291 07:01:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.291 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.291 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 43617592 kB' 'MemAvailable: 47912736 kB' 'Buffers: 2708 kB' 'Cached: 10989524 kB' 'SwapCached: 0 kB' 'Active: 7380488 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981060 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480812 kB' 'Mapped: 206904 kB' 'Shmem: 6503044 kB' 'KReclaimable: 450336 kB' 'Slab: 995208 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544872 kB' 'KernelStack: 12864 kB' 'PageTables: 8168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8057664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.291 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.291 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.292 07:01:35 -- setup/common.sh@33 -- # echo 0 00:03:32.292 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.292 07:01:35 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.292 07:01:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.292 07:01:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.292 07:01:35 -- setup/common.sh@18 -- # local node= 00:03:32.292 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.292 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.292 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.292 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.292 07:01:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.292 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.292 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 43619708 kB' 'MemAvailable: 47914852 kB' 'Buffers: 2708 kB' 'Cached: 10989536 kB' 'SwapCached: 0 kB' 'Active: 7378484 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979056 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479204 kB' 'Mapped: 206760 kB' 'Shmem: 6503056 kB' 'KReclaimable: 450336 kB' 'Slab: 995204 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544868 kB' 'KernelStack: 12816 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8057680 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.292 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.292 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.293 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.293 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.293 07:01:35 -- setup/common.sh@33 -- # echo 0 00:03:32.293 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.293 07:01:35 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.293 07:01:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:32.293 nr_hugepages=1536 00:03:32.293 07:01:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.293 resv_hugepages=0 00:03:32.293 07:01:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.293 surplus_hugepages=0 00:03:32.293 07:01:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.293 anon_hugepages=0 00:03:32.293 07:01:35 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:32.293 07:01:35 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:32.293 07:01:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.293 07:01:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.293 07:01:35 -- setup/common.sh@18 -- # local node= 00:03:32.293 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.294 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.294 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.294 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.294 07:01:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.294 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.294 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 43619708 kB' 'MemAvailable: 47914852 kB' 'Buffers: 2708 kB' 'Cached: 10989552 kB' 'SwapCached: 0 kB' 'Active: 7378340 kB' 'Inactive: 4089760 kB' 'Active(anon): 6978912 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479064 kB' 'Mapped: 206760 kB' 'Shmem: 6503072 kB' 'KReclaimable: 450336 kB' 'Slab: 995204 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544868 kB' 'KernelStack: 12800 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8057692 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.294 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.294 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.295 07:01:35 -- setup/common.sh@33 -- # echo 1536 00:03:32.295 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.295 07:01:35 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:32.295 07:01:35 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.295 07:01:35 -- setup/hugepages.sh@27 -- # local node 00:03:32.295 07:01:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.295 07:01:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:32.295 07:01:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.295 07:01:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:32.295 07:01:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.295 07:01:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.295 07:01:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.295 07:01:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.295 07:01:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.295 07:01:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.295 07:01:35 -- setup/common.sh@18 -- # local node=0 00:03:32.295 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.295 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.295 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.295 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.295 07:01:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.295 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.295 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20306156 kB' 'MemUsed: 12519700 kB' 'SwapCached: 0 kB' 'Active: 6139204 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898336 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806800 kB' 'Mapped: 172180 kB' 'AnonPages: 199232 kB' 'Shmem: 5702348 kB' 'KernelStack: 6344 kB' 'PageTables: 3768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586692 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 317004 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.295 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.295 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.296 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.296 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@33 -- # echo 0 00:03:32.555 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.555 07:01:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.555 07:01:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.555 07:01:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.555 07:01:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:32.555 07:01:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.555 07:01:35 -- setup/common.sh@18 -- # local node=1 00:03:32.555 07:01:35 -- setup/common.sh@19 -- # local var val 00:03:32.555 07:01:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.555 07:01:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.555 07:01:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:32.555 07:01:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:32.555 07:01:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.555 07:01:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709812 kB' 'MemFree: 23313940 kB' 'MemUsed: 4395872 kB' 'SwapCached: 0 kB' 'Active: 1239328 kB' 'Inactive: 226176 kB' 'Active(anon): 1080768 kB' 'Inactive(anon): 0 kB' 'Active(file): 158560 kB' 'Inactive(file): 226176 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1185476 kB' 'Mapped: 34580 kB' 'AnonPages: 280064 kB' 'Shmem: 800740 kB' 'KernelStack: 6472 kB' 'PageTables: 4092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 180648 kB' 'Slab: 408512 kB' 'SReclaimable: 180648 kB' 'SUnreclaim: 227864 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.555 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.555 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # continue 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.556 07:01:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.556 07:01:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.556 07:01:35 -- setup/common.sh@33 -- # echo 0 00:03:32.556 07:01:35 -- setup/common.sh@33 -- # return 0 00:03:32.556 07:01:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.556 07:01:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.556 07:01:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.556 07:01:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.556 07:01:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:32.556 node0=512 expecting 512 00:03:32.556 07:01:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.556 07:01:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.556 07:01:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.556 07:01:35 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:32.556 node1=1024 expecting 1024 00:03:32.556 07:01:35 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:32.556 00:03:32.556 real 0m1.499s 00:03:32.556 user 0m0.623s 00:03:32.556 sys 0m0.843s 00:03:32.556 07:01:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:32.556 07:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:32.556 ************************************ 00:03:32.556 END TEST custom_alloc 00:03:32.556 ************************************ 00:03:32.556 07:01:35 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:32.556 07:01:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:32.556 07:01:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:32.556 07:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:32.556 ************************************ 00:03:32.556 START TEST no_shrink_alloc 00:03:32.556 ************************************ 00:03:32.556 07:01:35 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:03:32.556 07:01:35 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:32.556 07:01:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:32.556 07:01:35 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:32.556 07:01:35 -- setup/hugepages.sh@51 -- # shift 00:03:32.556 07:01:35 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:32.556 07:01:35 -- setup/hugepages.sh@52 -- # local node_ids 00:03:32.556 07:01:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:32.556 07:01:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:32.556 07:01:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:32.556 07:01:35 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:32.556 07:01:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:32.556 07:01:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:32.556 07:01:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:32.556 07:01:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:32.556 07:01:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:32.556 07:01:35 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:32.556 07:01:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:32.556 07:01:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:32.556 07:01:35 -- setup/hugepages.sh@73 -- # return 0 00:03:32.556 07:01:35 -- setup/hugepages.sh@198 -- # setup output 00:03:32.556 07:01:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.556 07:01:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:33.491 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:33.491 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:33.491 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:33.491 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:33.491 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:33.491 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:33.491 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:33.491 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:33.491 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:33.491 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:33.491 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:33.491 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:33.491 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:33.491 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:33.491 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:33.491 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:33.491 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:33.753 07:01:36 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:33.753 07:01:36 -- setup/hugepages.sh@89 -- # local node 00:03:33.753 07:01:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:33.753 07:01:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:33.753 07:01:36 -- setup/hugepages.sh@92 -- # local surp 00:03:33.753 07:01:36 -- setup/hugepages.sh@93 -- # local resv 00:03:33.753 07:01:36 -- setup/hugepages.sh@94 -- # local anon 00:03:33.753 07:01:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:33.753 07:01:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:33.753 07:01:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:33.753 07:01:36 -- setup/common.sh@18 -- # local node= 00:03:33.753 07:01:36 -- setup/common.sh@19 -- # local var val 00:03:33.753 07:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.753 07:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.753 07:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.753 07:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.753 07:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.753 07:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44648804 kB' 'MemAvailable: 48943948 kB' 'Buffers: 2708 kB' 'Cached: 10989612 kB' 'SwapCached: 0 kB' 'Active: 7379220 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979792 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479880 kB' 'Mapped: 206780 kB' 'Shmem: 6503132 kB' 'KReclaimable: 450336 kB' 'Slab: 995040 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544704 kB' 'KernelStack: 12848 kB' 'PageTables: 7920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8057624 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.753 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.753 07:01:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.754 07:01:36 -- setup/common.sh@33 -- # echo 0 00:03:33.754 07:01:36 -- setup/common.sh@33 -- # return 0 00:03:33.754 07:01:36 -- setup/hugepages.sh@97 -- # anon=0 00:03:33.754 07:01:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:33.754 07:01:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:33.754 07:01:36 -- setup/common.sh@18 -- # local node= 00:03:33.754 07:01:36 -- setup/common.sh@19 -- # local var val 00:03:33.754 07:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.754 07:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.754 07:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.754 07:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.754 07:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.754 07:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44651104 kB' 'MemAvailable: 48946248 kB' 'Buffers: 2708 kB' 'Cached: 10989612 kB' 'SwapCached: 0 kB' 'Active: 7379392 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979964 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480040 kB' 'Mapped: 206784 kB' 'Shmem: 6503132 kB' 'KReclaimable: 450336 kB' 'Slab: 995024 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544688 kB' 'KernelStack: 12832 kB' 'PageTables: 7804 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8057636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.754 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.754 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.755 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.755 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.755 07:01:36 -- setup/common.sh@33 -- # echo 0 00:03:33.756 07:01:36 -- setup/common.sh@33 -- # return 0 00:03:33.756 07:01:36 -- setup/hugepages.sh@99 -- # surp=0 00:03:33.756 07:01:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:33.756 07:01:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:33.756 07:01:36 -- setup/common.sh@18 -- # local node= 00:03:33.756 07:01:36 -- setup/common.sh@19 -- # local var val 00:03:33.756 07:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.756 07:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.756 07:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.756 07:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.756 07:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.756 07:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44652428 kB' 'MemAvailable: 48947572 kB' 'Buffers: 2708 kB' 'Cached: 10989632 kB' 'SwapCached: 0 kB' 'Active: 7378960 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979532 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479224 kB' 'Mapped: 206776 kB' 'Shmem: 6503152 kB' 'KReclaimable: 450336 kB' 'Slab: 995040 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544704 kB' 'KernelStack: 12816 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8057656 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.756 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.756 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.757 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.757 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.757 07:01:36 -- setup/common.sh@33 -- # echo 0 00:03:33.757 07:01:36 -- setup/common.sh@33 -- # return 0 00:03:33.757 07:01:36 -- setup/hugepages.sh@100 -- # resv=0 00:03:33.757 07:01:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:33.757 nr_hugepages=1024 00:03:33.757 07:01:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:33.757 resv_hugepages=0 00:03:33.758 07:01:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:33.758 surplus_hugepages=0 00:03:33.758 07:01:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:33.758 anon_hugepages=0 00:03:33.758 07:01:36 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:33.758 07:01:36 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:33.758 07:01:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:33.758 07:01:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:33.758 07:01:36 -- setup/common.sh@18 -- # local node= 00:03:33.758 07:01:36 -- setup/common.sh@19 -- # local var val 00:03:33.758 07:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.758 07:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.758 07:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.758 07:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.758 07:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.758 07:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44652468 kB' 'MemAvailable: 48947612 kB' 'Buffers: 2708 kB' 'Cached: 10989644 kB' 'SwapCached: 0 kB' 'Active: 7378796 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979368 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479464 kB' 'Mapped: 206768 kB' 'Shmem: 6503164 kB' 'KReclaimable: 450336 kB' 'Slab: 995040 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544704 kB' 'KernelStack: 12848 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8058040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.758 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.758 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # continue 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.759 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.759 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.759 07:01:36 -- setup/common.sh@33 -- # echo 1024 00:03:33.759 07:01:36 -- setup/common.sh@33 -- # return 0 00:03:34.018 07:01:36 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:34.018 07:01:36 -- setup/hugepages.sh@112 -- # get_nodes 00:03:34.018 07:01:36 -- setup/hugepages.sh@27 -- # local node 00:03:34.018 07:01:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.018 07:01:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:34.018 07:01:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:34.018 07:01:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:34.018 07:01:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:34.018 07:01:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:34.018 07:01:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:34.018 07:01:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:34.018 07:01:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:34.018 07:01:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:34.018 07:01:36 -- setup/common.sh@18 -- # local node=0 00:03:34.018 07:01:36 -- setup/common.sh@19 -- # local var val 00:03:34.018 07:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:34.018 07:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:34.018 07:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:34.018 07:01:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:34.018 07:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:34.018 07:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:34.018 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 19242316 kB' 'MemUsed: 13583540 kB' 'SwapCached: 0 kB' 'Active: 6139416 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898548 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806888 kB' 'Mapped: 172192 kB' 'AnonPages: 199320 kB' 'Shmem: 5702436 kB' 'KernelStack: 6344 kB' 'PageTables: 3716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586548 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 316860 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # continue 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:34.019 07:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:34.019 07:01:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:34.019 07:01:36 -- setup/common.sh@33 -- # echo 0 00:03:34.019 07:01:36 -- setup/common.sh@33 -- # return 0 00:03:34.019 07:01:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:34.019 07:01:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:34.019 07:01:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:34.019 07:01:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:34.019 07:01:36 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:34.019 node0=1024 expecting 1024 00:03:34.019 07:01:36 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:34.019 07:01:36 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:34.019 07:01:36 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:34.019 07:01:36 -- setup/hugepages.sh@202 -- # setup output 00:03:34.019 07:01:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.019 07:01:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:34.954 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:34.954 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:34.954 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:34.954 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.215 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.215 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.215 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.215 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.215 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.215 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:35.215 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:35.215 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:35.215 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:35.215 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:35.215 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:35.215 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:35.215 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:35.215 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:35.215 07:01:38 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:35.215 07:01:38 -- setup/hugepages.sh@89 -- # local node 00:03:35.215 07:01:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:35.215 07:01:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:35.215 07:01:38 -- setup/hugepages.sh@92 -- # local surp 00:03:35.215 07:01:38 -- setup/hugepages.sh@93 -- # local resv 00:03:35.215 07:01:38 -- setup/hugepages.sh@94 -- # local anon 00:03:35.215 07:01:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:35.215 07:01:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:35.215 07:01:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:35.215 07:01:38 -- setup/common.sh@18 -- # local node= 00:03:35.215 07:01:38 -- setup/common.sh@19 -- # local var val 00:03:35.215 07:01:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.215 07:01:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.215 07:01:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.215 07:01:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.215 07:01:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.215 07:01:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.215 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.215 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44644252 kB' 'MemAvailable: 48939396 kB' 'Buffers: 2708 kB' 'Cached: 10989696 kB' 'SwapCached: 0 kB' 'Active: 7381296 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981868 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481904 kB' 'Mapped: 206860 kB' 'Shmem: 6503216 kB' 'KReclaimable: 450336 kB' 'Slab: 994912 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544576 kB' 'KernelStack: 13184 kB' 'PageTables: 9320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8060992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198824 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.216 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.216 07:01:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:35.216 07:01:38 -- setup/common.sh@33 -- # echo 0 00:03:35.216 07:01:38 -- setup/common.sh@33 -- # return 0 00:03:35.216 07:01:38 -- setup/hugepages.sh@97 -- # anon=0 00:03:35.216 07:01:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:35.216 07:01:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.216 07:01:38 -- setup/common.sh@18 -- # local node= 00:03:35.216 07:01:38 -- setup/common.sh@19 -- # local var val 00:03:35.216 07:01:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.216 07:01:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.217 07:01:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.217 07:01:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.217 07:01:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.217 07:01:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44653344 kB' 'MemAvailable: 48948488 kB' 'Buffers: 2708 kB' 'Cached: 10989696 kB' 'SwapCached: 0 kB' 'Active: 7380924 kB' 'Inactive: 4089760 kB' 'Active(anon): 6981496 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481528 kB' 'Mapped: 206864 kB' 'Shmem: 6503216 kB' 'KReclaimable: 450336 kB' 'Slab: 994888 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544552 kB' 'KernelStack: 13152 kB' 'PageTables: 9344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8062148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198696 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.217 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.217 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.218 07:01:38 -- setup/common.sh@33 -- # echo 0 00:03:35.218 07:01:38 -- setup/common.sh@33 -- # return 0 00:03:35.218 07:01:38 -- setup/hugepages.sh@99 -- # surp=0 00:03:35.218 07:01:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:35.218 07:01:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:35.218 07:01:38 -- setup/common.sh@18 -- # local node= 00:03:35.218 07:01:38 -- setup/common.sh@19 -- # local var val 00:03:35.218 07:01:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.218 07:01:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.218 07:01:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.218 07:01:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.218 07:01:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.218 07:01:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44651824 kB' 'MemAvailable: 48946968 kB' 'Buffers: 2708 kB' 'Cached: 10989696 kB' 'SwapCached: 0 kB' 'Active: 7380244 kB' 'Inactive: 4089760 kB' 'Active(anon): 6980816 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481176 kB' 'Mapped: 206832 kB' 'Shmem: 6503216 kB' 'KReclaimable: 450336 kB' 'Slab: 994888 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544552 kB' 'KernelStack: 13184 kB' 'PageTables: 8920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8062412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198680 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.218 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.218 07:01:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:35.219 07:01:38 -- setup/common.sh@33 -- # echo 0 00:03:35.219 07:01:38 -- setup/common.sh@33 -- # return 0 00:03:35.219 07:01:38 -- setup/hugepages.sh@100 -- # resv=0 00:03:35.219 07:01:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:35.219 nr_hugepages=1024 00:03:35.219 07:01:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:35.219 resv_hugepages=0 00:03:35.219 07:01:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:35.219 surplus_hugepages=0 00:03:35.219 07:01:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:35.219 anon_hugepages=0 00:03:35.219 07:01:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:35.219 07:01:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:35.219 07:01:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:35.219 07:01:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:35.219 07:01:38 -- setup/common.sh@18 -- # local node= 00:03:35.219 07:01:38 -- setup/common.sh@19 -- # local var val 00:03:35.219 07:01:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.219 07:01:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.219 07:01:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:35.219 07:01:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:35.219 07:01:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.219 07:01:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535668 kB' 'MemFree: 44652588 kB' 'MemAvailable: 48947732 kB' 'Buffers: 2708 kB' 'Cached: 10989724 kB' 'SwapCached: 0 kB' 'Active: 7379424 kB' 'Inactive: 4089760 kB' 'Active(anon): 6979996 kB' 'Inactive(anon): 0 kB' 'Active(file): 399428 kB' 'Inactive(file): 4089760 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479912 kB' 'Mapped: 206780 kB' 'Shmem: 6503244 kB' 'KReclaimable: 450336 kB' 'Slab: 995040 kB' 'SReclaimable: 450336 kB' 'SUnreclaim: 544704 kB' 'KernelStack: 12848 kB' 'PageTables: 7720 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8058252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 39168 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.219 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.219 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.220 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.220 07:01:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.221 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.221 07:01:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:35.479 07:01:38 -- setup/common.sh@33 -- # echo 1024 00:03:35.479 07:01:38 -- setup/common.sh@33 -- # return 0 00:03:35.479 07:01:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:35.479 07:01:38 -- setup/hugepages.sh@112 -- # get_nodes 00:03:35.479 07:01:38 -- setup/hugepages.sh@27 -- # local node 00:03:35.479 07:01:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.479 07:01:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:35.479 07:01:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:35.479 07:01:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:35.479 07:01:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:35.479 07:01:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:35.479 07:01:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:35.479 07:01:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:35.479 07:01:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:35.479 07:01:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:35.479 07:01:38 -- setup/common.sh@18 -- # local node=0 00:03:35.479 07:01:38 -- setup/common.sh@19 -- # local var val 00:03:35.479 07:01:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:35.479 07:01:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:35.479 07:01:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:35.479 07:01:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:35.479 07:01:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:35.479 07:01:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 19252144 kB' 'MemUsed: 13573712 kB' 'SwapCached: 0 kB' 'Active: 6139836 kB' 'Inactive: 3863584 kB' 'Active(anon): 5898968 kB' 'Inactive(anon): 0 kB' 'Active(file): 240868 kB' 'Inactive(file): 3863584 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9806940 kB' 'Mapped: 172200 kB' 'AnonPages: 199576 kB' 'Shmem: 5702488 kB' 'KernelStack: 6360 kB' 'PageTables: 3752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 269688 kB' 'Slab: 586488 kB' 'SReclaimable: 269688 kB' 'SUnreclaim: 316800 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.479 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.479 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # continue 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:35.480 07:01:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:35.480 07:01:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:35.480 07:01:38 -- setup/common.sh@33 -- # echo 0 00:03:35.480 07:01:38 -- setup/common.sh@33 -- # return 0 00:03:35.480 07:01:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:35.480 07:01:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:35.480 07:01:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:35.480 07:01:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:35.480 07:01:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:35.480 node0=1024 expecting 1024 00:03:35.480 07:01:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:35.480 00:03:35.480 real 0m2.904s 00:03:35.480 user 0m1.156s 00:03:35.480 sys 0m1.678s 00:03:35.480 07:01:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.480 07:01:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.480 ************************************ 00:03:35.480 END TEST no_shrink_alloc 00:03:35.480 ************************************ 00:03:35.480 07:01:38 -- setup/hugepages.sh@217 -- # clear_hp 00:03:35.480 07:01:38 -- setup/hugepages.sh@37 -- # local node hp 00:03:35.480 07:01:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:35.480 07:01:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.480 07:01:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.480 07:01:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.480 07:01:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.480 07:01:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:35.480 07:01:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.480 07:01:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.480 07:01:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:35.480 07:01:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:35.480 07:01:38 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:35.480 07:01:38 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:35.480 00:03:35.480 real 0m11.655s 00:03:35.480 user 0m4.378s 00:03:35.480 sys 0m6.215s 00:03:35.480 07:01:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.480 07:01:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.480 ************************************ 00:03:35.480 END TEST hugepages 00:03:35.480 ************************************ 00:03:35.480 07:01:38 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:35.480 07:01:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:35.480 07:01:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:35.480 07:01:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.480 ************************************ 00:03:35.480 START TEST driver 00:03:35.480 ************************************ 00:03:35.480 07:01:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:35.480 * Looking for test storage... 00:03:35.481 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:35.481 07:01:38 -- setup/driver.sh@68 -- # setup reset 00:03:35.481 07:01:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:35.481 07:01:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.128 07:01:40 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:38.128 07:01:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:38.128 07:01:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:38.128 07:01:40 -- common/autotest_common.sh@10 -- # set +x 00:03:38.128 ************************************ 00:03:38.128 START TEST guess_driver 00:03:38.128 ************************************ 00:03:38.128 07:01:40 -- common/autotest_common.sh@1104 -- # guess_driver 00:03:38.128 07:01:40 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:38.128 07:01:40 -- setup/driver.sh@47 -- # local fail=0 00:03:38.128 07:01:40 -- setup/driver.sh@49 -- # pick_driver 00:03:38.128 07:01:40 -- setup/driver.sh@36 -- # vfio 00:03:38.128 07:01:40 -- setup/driver.sh@21 -- # local iommu_grups 00:03:38.128 07:01:40 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:38.128 07:01:40 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:38.128 07:01:40 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:38.128 07:01:40 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:38.128 07:01:40 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:38.128 07:01:40 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:38.128 07:01:40 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:38.128 07:01:40 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:38.128 07:01:40 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:38.128 07:01:40 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:38.128 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:38.128 07:01:40 -- setup/driver.sh@30 -- # return 0 00:03:38.128 07:01:40 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:38.128 07:01:40 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:38.128 07:01:40 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:38.128 07:01:40 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:38.128 Looking for driver=vfio-pci 00:03:38.128 07:01:40 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:38.128 07:01:40 -- setup/driver.sh@45 -- # setup output config 00:03:38.128 07:01:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.128 07:01:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:39.063 07:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.063 07:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.063 07:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.063 07:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.063 07:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.063 07:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.063 07:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.063 07:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.063 07:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.063 07:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.063 07:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.063 07:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:39.322 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:39.322 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:39.322 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.256 07:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.256 07:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.256 07:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.256 07:01:43 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:40.256 07:01:43 -- setup/driver.sh@65 -- # setup reset 00:03:40.256 07:01:43 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:40.256 07:01:43 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:42.785 00:03:42.785 real 0m4.854s 00:03:42.785 user 0m1.156s 00:03:42.785 sys 0m1.866s 00:03:42.785 07:01:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:42.785 07:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:42.785 ************************************ 00:03:42.785 END TEST guess_driver 00:03:42.785 ************************************ 00:03:42.785 00:03:42.785 real 0m7.430s 00:03:42.785 user 0m1.734s 00:03:42.785 sys 0m2.912s 00:03:42.785 07:01:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:42.785 07:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:42.785 ************************************ 00:03:42.785 END TEST driver 00:03:42.785 ************************************ 00:03:42.785 07:01:45 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:42.785 07:01:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:42.785 07:01:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:42.785 07:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:42.785 ************************************ 00:03:42.785 START TEST devices 00:03:42.785 ************************************ 00:03:42.785 07:01:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:43.043 * Looking for test storage... 00:03:43.043 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:43.043 07:01:45 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:43.043 07:01:45 -- setup/devices.sh@192 -- # setup reset 00:03:43.043 07:01:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:43.043 07:01:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:44.416 07:01:47 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:44.416 07:01:47 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:44.416 07:01:47 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:44.416 07:01:47 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:44.416 07:01:47 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:44.416 07:01:47 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:44.416 07:01:47 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:44.416 07:01:47 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:44.416 07:01:47 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:44.416 07:01:47 -- setup/devices.sh@196 -- # blocks=() 00:03:44.416 07:01:47 -- setup/devices.sh@196 -- # declare -a blocks 00:03:44.416 07:01:47 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:44.416 07:01:47 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:44.416 07:01:47 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:44.416 07:01:47 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:44.416 07:01:47 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:44.416 07:01:47 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:44.416 07:01:47 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:44.416 07:01:47 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:44.416 07:01:47 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:44.416 07:01:47 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:44.416 07:01:47 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:44.416 No valid GPT data, bailing 00:03:44.416 07:01:47 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:44.416 07:01:47 -- scripts/common.sh@393 -- # pt= 00:03:44.416 07:01:47 -- scripts/common.sh@394 -- # return 1 00:03:44.416 07:01:47 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:44.416 07:01:47 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:44.416 07:01:47 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:44.416 07:01:47 -- setup/common.sh@80 -- # echo 1000204886016 00:03:44.416 07:01:47 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:44.416 07:01:47 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:44.416 07:01:47 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:44.416 07:01:47 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:44.416 07:01:47 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:44.416 07:01:47 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:44.416 07:01:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:44.416 07:01:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:44.416 07:01:47 -- common/autotest_common.sh@10 -- # set +x 00:03:44.416 ************************************ 00:03:44.416 START TEST nvme_mount 00:03:44.416 ************************************ 00:03:44.416 07:01:47 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:44.416 07:01:47 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:44.416 07:01:47 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:44.416 07:01:47 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.416 07:01:47 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.416 07:01:47 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:44.416 07:01:47 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:44.416 07:01:47 -- setup/common.sh@40 -- # local part_no=1 00:03:44.416 07:01:47 -- setup/common.sh@41 -- # local size=1073741824 00:03:44.416 07:01:47 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:44.416 07:01:47 -- setup/common.sh@44 -- # parts=() 00:03:44.416 07:01:47 -- setup/common.sh@44 -- # local parts 00:03:44.416 07:01:47 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:44.416 07:01:47 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:44.416 07:01:47 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:44.416 07:01:47 -- setup/common.sh@46 -- # (( part++ )) 00:03:44.416 07:01:47 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:44.416 07:01:47 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:44.416 07:01:47 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:44.416 07:01:47 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:45.351 Creating new GPT entries in memory. 00:03:45.351 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:45.351 other utilities. 00:03:45.351 07:01:48 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:45.351 07:01:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:45.351 07:01:48 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:45.351 07:01:48 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:45.351 07:01:48 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:46.725 Creating new GPT entries in memory. 00:03:46.725 The operation has completed successfully. 00:03:46.725 07:01:49 -- setup/common.sh@57 -- # (( part++ )) 00:03:46.725 07:01:49 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:46.725 07:01:49 -- setup/common.sh@62 -- # wait 1768965 00:03:46.725 07:01:49 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.725 07:01:49 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:46.725 07:01:49 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.725 07:01:49 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:46.725 07:01:49 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:46.725 07:01:49 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.725 07:01:49 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.725 07:01:49 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:46.725 07:01:49 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:46.725 07:01:49 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.725 07:01:49 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.725 07:01:49 -- setup/devices.sh@53 -- # local found=0 00:03:46.725 07:01:49 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.725 07:01:49 -- setup/devices.sh@56 -- # : 00:03:46.725 07:01:49 -- setup/devices.sh@59 -- # local pci status 00:03:46.725 07:01:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.725 07:01:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:46.725 07:01:49 -- setup/devices.sh@47 -- # setup output config 00:03:46.725 07:01:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.725 07:01:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:47.659 07:01:50 -- setup/devices.sh@63 -- # found=1 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.659 07:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.659 07:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.918 07:01:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:47.918 07:01:50 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:47.918 07:01:50 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.918 07:01:50 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:47.918 07:01:50 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:47.918 07:01:50 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:47.918 07:01:50 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.918 07:01:50 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.918 07:01:50 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.918 07:01:50 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:47.918 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:47.918 07:01:50 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:47.918 07:01:50 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:48.177 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:48.177 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:48.177 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:48.177 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:48.177 07:01:50 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:48.177 07:01:50 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:48.177 07:01:50 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.177 07:01:51 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:48.177 07:01:51 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:48.177 07:01:51 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.177 07:01:51 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:48.177 07:01:51 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:48.177 07:01:51 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:48.177 07:01:51 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:48.177 07:01:51 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:48.177 07:01:51 -- setup/devices.sh@53 -- # local found=0 00:03:48.177 07:01:51 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:48.177 07:01:51 -- setup/devices.sh@56 -- # : 00:03:48.177 07:01:51 -- setup/devices.sh@59 -- # local pci status 00:03:48.177 07:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:48.177 07:01:51 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:48.177 07:01:51 -- setup/devices.sh@47 -- # setup output config 00:03:48.177 07:01:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:48.177 07:01:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:49.553 07:01:52 -- setup/devices.sh@63 -- # found=1 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.553 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.553 07:01:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:49.554 07:01:52 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:49.554 07:01:52 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.554 07:01:52 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:49.554 07:01:52 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.554 07:01:52 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.554 07:01:52 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:49.554 07:01:52 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:49.554 07:01:52 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:49.554 07:01:52 -- setup/devices.sh@50 -- # local mount_point= 00:03:49.554 07:01:52 -- setup/devices.sh@51 -- # local test_file= 00:03:49.554 07:01:52 -- setup/devices.sh@53 -- # local found=0 00:03:49.554 07:01:52 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:49.554 07:01:52 -- setup/devices.sh@59 -- # local pci status 00:03:49.554 07:01:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.554 07:01:52 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:49.554 07:01:52 -- setup/devices.sh@47 -- # setup output config 00:03:49.554 07:01:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.554 07:01:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:50.930 07:01:53 -- setup/devices.sh@63 -- # found=1 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:50.930 07:01:53 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:50.930 07:01:53 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:50.930 07:01:53 -- setup/devices.sh@68 -- # return 0 00:03:50.930 07:01:53 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:50.930 07:01:53 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:50.930 07:01:53 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:50.930 07:01:53 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:50.930 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:50.930 00:03:50.930 real 0m6.459s 00:03:50.930 user 0m1.483s 00:03:50.930 sys 0m2.539s 00:03:50.930 07:01:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:50.930 07:01:53 -- common/autotest_common.sh@10 -- # set +x 00:03:50.930 ************************************ 00:03:50.930 END TEST nvme_mount 00:03:50.930 ************************************ 00:03:50.930 07:01:53 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:50.930 07:01:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:50.930 07:01:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:50.930 07:01:53 -- common/autotest_common.sh@10 -- # set +x 00:03:50.930 ************************************ 00:03:50.930 START TEST dm_mount 00:03:50.930 ************************************ 00:03:50.930 07:01:53 -- common/autotest_common.sh@1104 -- # dm_mount 00:03:50.930 07:01:53 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:50.930 07:01:53 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:50.930 07:01:53 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:50.930 07:01:53 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:50.930 07:01:53 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:50.930 07:01:53 -- setup/common.sh@40 -- # local part_no=2 00:03:50.930 07:01:53 -- setup/common.sh@41 -- # local size=1073741824 00:03:50.930 07:01:53 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:50.930 07:01:53 -- setup/common.sh@44 -- # parts=() 00:03:50.930 07:01:53 -- setup/common.sh@44 -- # local parts 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:50.930 07:01:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part++ )) 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:50.930 07:01:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part++ )) 00:03:50.930 07:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:50.930 07:01:53 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:50.930 07:01:53 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:50.930 07:01:53 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:51.865 Creating new GPT entries in memory. 00:03:51.865 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:51.865 other utilities. 00:03:51.866 07:01:54 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:51.866 07:01:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:51.866 07:01:54 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:51.866 07:01:54 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:51.866 07:01:54 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:53.241 Creating new GPT entries in memory. 00:03:53.241 The operation has completed successfully. 00:03:53.241 07:01:55 -- setup/common.sh@57 -- # (( part++ )) 00:03:53.241 07:01:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:53.241 07:01:55 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:53.241 07:01:55 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:53.241 07:01:55 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:54.176 The operation has completed successfully. 00:03:54.176 07:01:56 -- setup/common.sh@57 -- # (( part++ )) 00:03:54.176 07:01:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:54.176 07:01:56 -- setup/common.sh@62 -- # wait 1771431 00:03:54.176 07:01:56 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:54.176 07:01:56 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.176 07:01:56 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.176 07:01:56 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:54.176 07:01:56 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:54.176 07:01:56 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.176 07:01:56 -- setup/devices.sh@161 -- # break 00:03:54.176 07:01:56 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.176 07:01:56 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:54.176 07:01:56 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:54.176 07:01:56 -- setup/devices.sh@166 -- # dm=dm-0 00:03:54.176 07:01:56 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:54.176 07:01:56 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:54.176 07:01:56 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.176 07:01:56 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:54.176 07:01:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.176 07:01:56 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:54.176 07:01:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:54.176 07:01:56 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.176 07:01:56 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.176 07:01:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:54.176 07:01:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:54.176 07:01:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:54.176 07:01:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:54.176 07:01:56 -- setup/devices.sh@53 -- # local found=0 00:03:54.176 07:01:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:54.176 07:01:56 -- setup/devices.sh@56 -- # : 00:03:54.176 07:01:56 -- setup/devices.sh@59 -- # local pci status 00:03:54.176 07:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:54.176 07:01:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:54.177 07:01:56 -- setup/devices.sh@47 -- # setup output config 00:03:54.177 07:01:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:54.177 07:01:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:55.551 07:01:58 -- setup/devices.sh@63 -- # found=1 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:55.551 07:01:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:55.551 07:01:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.551 07:01:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:55.551 07:01:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:55.551 07:01:58 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.551 07:01:58 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:55.551 07:01:58 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:55.551 07:01:58 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:55.551 07:01:58 -- setup/devices.sh@50 -- # local mount_point= 00:03:55.551 07:01:58 -- setup/devices.sh@51 -- # local test_file= 00:03:55.551 07:01:58 -- setup/devices.sh@53 -- # local found=0 00:03:55.551 07:01:58 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:55.551 07:01:58 -- setup/devices.sh@59 -- # local pci status 00:03:55.551 07:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.551 07:01:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:55.551 07:01:58 -- setup/devices.sh@47 -- # setup output config 00:03:55.551 07:01:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:55.551 07:01:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:56.485 07:01:59 -- setup/devices.sh@63 -- # found=1 00:03:56.485 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.485 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.485 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.485 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.485 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.485 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.743 07:01:59 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:56.743 07:01:59 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:56.743 07:01:59 -- setup/devices.sh@68 -- # return 0 00:03:56.743 07:01:59 -- setup/devices.sh@187 -- # cleanup_dm 00:03:56.743 07:01:59 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:56.743 07:01:59 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:56.743 07:01:59 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:56.743 07:01:59 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:56.743 07:01:59 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:57.001 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:57.001 07:01:59 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:57.001 07:01:59 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:57.001 00:03:57.001 real 0m5.939s 00:03:57.001 user 0m1.014s 00:03:57.001 sys 0m1.792s 00:03:57.001 07:01:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:57.001 07:01:59 -- common/autotest_common.sh@10 -- # set +x 00:03:57.001 ************************************ 00:03:57.001 END TEST dm_mount 00:03:57.001 ************************************ 00:03:57.001 07:01:59 -- setup/devices.sh@1 -- # cleanup 00:03:57.001 07:01:59 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:57.001 07:01:59 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.001 07:01:59 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:57.001 07:01:59 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:57.001 07:01:59 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:57.001 07:01:59 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:57.260 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:57.260 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:57.260 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:57.260 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:57.260 07:01:59 -- setup/devices.sh@12 -- # cleanup_dm 00:03:57.260 07:01:59 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:57.260 07:01:59 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:57.260 07:01:59 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:57.260 07:01:59 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:57.260 07:01:59 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:57.260 07:01:59 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:57.260 00:03:57.260 real 0m14.303s 00:03:57.260 user 0m3.127s 00:03:57.260 sys 0m5.369s 00:03:57.260 07:01:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:57.260 07:01:59 -- common/autotest_common.sh@10 -- # set +x 00:03:57.260 ************************************ 00:03:57.260 END TEST devices 00:03:57.260 ************************************ 00:03:57.260 00:03:57.260 real 0m43.790s 00:03:57.260 user 0m12.468s 00:03:57.260 sys 0m19.807s 00:03:57.260 07:02:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:57.260 07:02:00 -- common/autotest_common.sh@10 -- # set +x 00:03:57.260 ************************************ 00:03:57.260 END TEST setup.sh 00:03:57.260 ************************************ 00:03:57.260 07:02:00 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:58.634 Hugepages 00:03:58.634 node hugesize free / total 00:03:58.634 node0 1048576kB 0 / 0 00:03:58.634 node0 2048kB 2048 / 2048 00:03:58.634 node1 1048576kB 0 / 0 00:03:58.634 node1 2048kB 0 / 0 00:03:58.634 00:03:58.635 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:58.635 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:58.635 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:58.635 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:58.635 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:58.635 07:02:01 -- spdk/autotest.sh@141 -- # uname -s 00:03:58.635 07:02:01 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:03:58.635 07:02:01 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:03:58.635 07:02:01 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:59.569 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:59.569 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:59.569 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:59.569 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:59.827 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:00.761 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:00.761 07:02:03 -- common/autotest_common.sh@1517 -- # sleep 1 00:04:01.696 07:02:04 -- common/autotest_common.sh@1518 -- # bdfs=() 00:04:01.696 07:02:04 -- common/autotest_common.sh@1518 -- # local bdfs 00:04:01.696 07:02:04 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:04:01.696 07:02:04 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:04:01.696 07:02:04 -- common/autotest_common.sh@1498 -- # bdfs=() 00:04:01.696 07:02:04 -- common/autotest_common.sh@1498 -- # local bdfs 00:04:01.696 07:02:04 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:01.696 07:02:04 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:01.696 07:02:04 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:04:01.696 07:02:04 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:04:01.696 07:02:04 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:04:01.696 07:02:04 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:03.071 Waiting for block devices as requested 00:04:03.071 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:03.071 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:03.071 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:03.330 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:03.330 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:03.330 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:03.330 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:03.588 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:03.588 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:03.588 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:03.588 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:03.846 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:03.846 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:03.846 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:03.846 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:04.104 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:04.105 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:04.105 07:02:07 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:04:04.105 07:02:07 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:04:04.105 07:02:07 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:04.105 07:02:07 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:04:04.105 07:02:07 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1530 -- # grep oacs 00:04:04.105 07:02:07 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:04:04.105 07:02:07 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:04:04.105 07:02:07 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:04:04.105 07:02:07 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:04:04.105 07:02:07 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:04:04.105 07:02:07 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:04:04.105 07:02:07 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:04:04.105 07:02:07 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:04:04.105 07:02:07 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:04:04.105 07:02:07 -- common/autotest_common.sh@1542 -- # continue 00:04:04.105 07:02:07 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:04:04.105 07:02:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:04.105 07:02:07 -- common/autotest_common.sh@10 -- # set +x 00:04:04.363 07:02:07 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:04:04.363 07:02:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:04.363 07:02:07 -- common/autotest_common.sh@10 -- # set +x 00:04:04.363 07:02:07 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:05.737 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:05.737 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:05.737 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:05.737 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:05.737 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:05.737 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:05.738 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:05.738 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:05.738 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:05.738 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:06.672 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:06.672 07:02:09 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:04:06.672 07:02:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:06.672 07:02:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.672 07:02:09 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:04:06.672 07:02:09 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:04:06.672 07:02:09 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:04:06.672 07:02:09 -- common/autotest_common.sh@1562 -- # bdfs=() 00:04:06.672 07:02:09 -- common/autotest_common.sh@1562 -- # local bdfs 00:04:06.672 07:02:09 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:04:06.672 07:02:09 -- common/autotest_common.sh@1498 -- # bdfs=() 00:04:06.672 07:02:09 -- common/autotest_common.sh@1498 -- # local bdfs 00:04:06.672 07:02:09 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:06.672 07:02:09 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:06.672 07:02:09 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:04:06.672 07:02:09 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:04:06.672 07:02:09 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:04:06.672 07:02:09 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:04:06.672 07:02:09 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:06.672 07:02:09 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:04:06.672 07:02:09 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:06.672 07:02:09 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:04:06.672 07:02:09 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:04:06.672 07:02:09 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:04:06.672 07:02:09 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=1776861 00:04:06.672 07:02:09 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:06.672 07:02:09 -- common/autotest_common.sh@1583 -- # waitforlisten 1776861 00:04:06.672 07:02:09 -- common/autotest_common.sh@819 -- # '[' -z 1776861 ']' 00:04:06.672 07:02:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:06.672 07:02:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:06.672 07:02:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:06.672 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:06.672 07:02:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:06.672 07:02:09 -- common/autotest_common.sh@10 -- # set +x 00:04:06.672 [2024-10-16 07:02:09.551341] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:06.672 [2024-10-16 07:02:09.551441] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1776861 ] 00:04:06.672 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.930 [2024-10-16 07:02:09.616411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:06.930 [2024-10-16 07:02:09.729939] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:06.930 [2024-10-16 07:02:09.730131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.865 07:02:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:07.865 07:02:10 -- common/autotest_common.sh@852 -- # return 0 00:04:07.865 07:02:10 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:04:07.865 07:02:10 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:04:07.865 07:02:10 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:11.145 nvme0n1 00:04:11.145 07:02:13 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:11.145 [2024-10-16 07:02:13.832716] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:11.145 [2024-10-16 07:02:13.832788] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:11.145 request: 00:04:11.145 { 00:04:11.145 "nvme_ctrlr_name": "nvme0", 00:04:11.145 "password": "test", 00:04:11.145 "method": "bdev_nvme_opal_revert", 00:04:11.145 "req_id": 1 00:04:11.145 } 00:04:11.145 Got JSON-RPC error response 00:04:11.145 response: 00:04:11.145 { 00:04:11.145 "code": -32603, 00:04:11.145 "message": "Internal error" 00:04:11.145 } 00:04:11.145 07:02:13 -- common/autotest_common.sh@1589 -- # true 00:04:11.145 07:02:13 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:04:11.145 07:02:13 -- common/autotest_common.sh@1593 -- # killprocess 1776861 00:04:11.145 07:02:13 -- common/autotest_common.sh@926 -- # '[' -z 1776861 ']' 00:04:11.145 07:02:13 -- common/autotest_common.sh@930 -- # kill -0 1776861 00:04:11.145 07:02:13 -- common/autotest_common.sh@931 -- # uname 00:04:11.145 07:02:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:11.145 07:02:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1776861 00:04:11.145 07:02:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:11.145 07:02:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:11.145 07:02:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1776861' 00:04:11.145 killing process with pid 1776861 00:04:11.145 07:02:13 -- common/autotest_common.sh@945 -- # kill 1776861 00:04:11.145 07:02:13 -- common/autotest_common.sh@950 -- # wait 1776861 00:04:13.072 07:02:15 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:04:13.072 07:02:15 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:04:13.072 07:02:15 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:13.072 07:02:15 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:13.072 07:02:15 -- spdk/autotest.sh@173 -- # timing_enter lib 00:04:13.072 07:02:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:13.072 07:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:13.072 07:02:15 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:13.072 07:02:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:13.072 07:02:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:13.072 07:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:13.072 ************************************ 00:04:13.072 START TEST env 00:04:13.072 ************************************ 00:04:13.072 07:02:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:13.072 * Looking for test storage... 00:04:13.072 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:13.072 07:02:15 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:13.072 07:02:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:13.072 07:02:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:13.072 07:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:13.072 ************************************ 00:04:13.072 START TEST env_memory 00:04:13.072 ************************************ 00:04:13.072 07:02:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:13.072 00:04:13.072 00:04:13.072 CUnit - A unit testing framework for C - Version 2.1-3 00:04:13.072 http://cunit.sourceforge.net/ 00:04:13.072 00:04:13.072 00:04:13.072 Suite: memory 00:04:13.072 Test: alloc and free memory map ...[2024-10-16 07:02:15.829270] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:13.072 passed 00:04:13.072 Test: mem map translation ...[2024-10-16 07:02:15.849600] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:13.072 [2024-10-16 07:02:15.849622] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:13.072 [2024-10-16 07:02:15.849671] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:13.072 [2024-10-16 07:02:15.849682] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:13.072 passed 00:04:13.072 Test: mem map registration ...[2024-10-16 07:02:15.891486] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:13.072 [2024-10-16 07:02:15.891505] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:13.072 passed 00:04:13.072 Test: mem map adjacent registrations ...passed 00:04:13.072 00:04:13.072 Run Summary: Type Total Ran Passed Failed Inactive 00:04:13.072 suites 1 1 n/a 0 0 00:04:13.072 tests 4 4 4 0 0 00:04:13.072 asserts 152 152 152 0 n/a 00:04:13.072 00:04:13.072 Elapsed time = 0.143 seconds 00:04:13.072 00:04:13.072 real 0m0.151s 00:04:13.072 user 0m0.139s 00:04:13.072 sys 0m0.012s 00:04:13.072 07:02:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:13.072 07:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:13.072 ************************************ 00:04:13.072 END TEST env_memory 00:04:13.072 ************************************ 00:04:13.072 07:02:15 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:13.072 07:02:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:13.072 07:02:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:13.072 07:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:13.072 ************************************ 00:04:13.072 START TEST env_vtophys 00:04:13.072 ************************************ 00:04:13.072 07:02:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:13.072 EAL: lib.eal log level changed from notice to debug 00:04:13.072 EAL: Detected lcore 0 as core 0 on socket 0 00:04:13.072 EAL: Detected lcore 1 as core 1 on socket 0 00:04:13.072 EAL: Detected lcore 2 as core 2 on socket 0 00:04:13.072 EAL: Detected lcore 3 as core 3 on socket 0 00:04:13.072 EAL: Detected lcore 4 as core 4 on socket 0 00:04:13.072 EAL: Detected lcore 5 as core 5 on socket 0 00:04:13.072 EAL: Detected lcore 6 as core 8 on socket 0 00:04:13.072 EAL: Detected lcore 7 as core 9 on socket 0 00:04:13.072 EAL: Detected lcore 8 as core 10 on socket 0 00:04:13.072 EAL: Detected lcore 9 as core 11 on socket 0 00:04:13.072 EAL: Detected lcore 10 as core 12 on socket 0 00:04:13.072 EAL: Detected lcore 11 as core 13 on socket 0 00:04:13.072 EAL: Detected lcore 12 as core 0 on socket 1 00:04:13.072 EAL: Detected lcore 13 as core 1 on socket 1 00:04:13.072 EAL: Detected lcore 14 as core 2 on socket 1 00:04:13.072 EAL: Detected lcore 15 as core 3 on socket 1 00:04:13.072 EAL: Detected lcore 16 as core 4 on socket 1 00:04:13.072 EAL: Detected lcore 17 as core 5 on socket 1 00:04:13.072 EAL: Detected lcore 18 as core 8 on socket 1 00:04:13.072 EAL: Detected lcore 19 as core 9 on socket 1 00:04:13.072 EAL: Detected lcore 20 as core 10 on socket 1 00:04:13.072 EAL: Detected lcore 21 as core 11 on socket 1 00:04:13.072 EAL: Detected lcore 22 as core 12 on socket 1 00:04:13.072 EAL: Detected lcore 23 as core 13 on socket 1 00:04:13.072 EAL: Detected lcore 24 as core 0 on socket 0 00:04:13.072 EAL: Detected lcore 25 as core 1 on socket 0 00:04:13.072 EAL: Detected lcore 26 as core 2 on socket 0 00:04:13.072 EAL: Detected lcore 27 as core 3 on socket 0 00:04:13.072 EAL: Detected lcore 28 as core 4 on socket 0 00:04:13.072 EAL: Detected lcore 29 as core 5 on socket 0 00:04:13.072 EAL: Detected lcore 30 as core 8 on socket 0 00:04:13.072 EAL: Detected lcore 31 as core 9 on socket 0 00:04:13.072 EAL: Detected lcore 32 as core 10 on socket 0 00:04:13.072 EAL: Detected lcore 33 as core 11 on socket 0 00:04:13.072 EAL: Detected lcore 34 as core 12 on socket 0 00:04:13.072 EAL: Detected lcore 35 as core 13 on socket 0 00:04:13.072 EAL: Detected lcore 36 as core 0 on socket 1 00:04:13.072 EAL: Detected lcore 37 as core 1 on socket 1 00:04:13.072 EAL: Detected lcore 38 as core 2 on socket 1 00:04:13.072 EAL: Detected lcore 39 as core 3 on socket 1 00:04:13.072 EAL: Detected lcore 40 as core 4 on socket 1 00:04:13.072 EAL: Detected lcore 41 as core 5 on socket 1 00:04:13.072 EAL: Detected lcore 42 as core 8 on socket 1 00:04:13.072 EAL: Detected lcore 43 as core 9 on socket 1 00:04:13.072 EAL: Detected lcore 44 as core 10 on socket 1 00:04:13.072 EAL: Detected lcore 45 as core 11 on socket 1 00:04:13.072 EAL: Detected lcore 46 as core 12 on socket 1 00:04:13.072 EAL: Detected lcore 47 as core 13 on socket 1 00:04:13.072 EAL: Maximum logical cores by configuration: 128 00:04:13.072 EAL: Detected CPU lcores: 48 00:04:13.072 EAL: Detected NUMA nodes: 2 00:04:13.072 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:13.072 EAL: Detected shared linkage of DPDK 00:04:13.072 EAL: No shared files mode enabled, IPC will be disabled 00:04:13.355 EAL: Bus pci wants IOVA as 'DC' 00:04:13.355 EAL: Buses did not request a specific IOVA mode. 00:04:13.355 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:13.355 EAL: Selected IOVA mode 'VA' 00:04:13.355 EAL: No free 2048 kB hugepages reported on node 1 00:04:13.355 EAL: Probing VFIO support... 00:04:13.355 EAL: IOMMU type 1 (Type 1) is supported 00:04:13.355 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:13.355 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:13.355 EAL: VFIO support initialized 00:04:13.355 EAL: Ask a virtual area of 0x2e000 bytes 00:04:13.355 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:13.355 EAL: Setting up physically contiguous memory... 00:04:13.355 EAL: Setting maximum number of open files to 524288 00:04:13.355 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:13.355 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:13.355 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:13.355 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:13.355 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.355 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:13.355 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:13.355 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:13.355 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.355 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:13.355 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:13.355 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:13.355 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.355 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:13.355 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:13.355 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:13.355 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.355 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:13.355 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:13.355 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:13.355 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:13.355 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.355 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:13.355 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:13.355 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.355 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:13.356 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:13.356 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.356 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:13.356 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:13.356 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.356 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:13.356 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:13.356 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.356 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:13.356 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:13.356 EAL: Ask a virtual area of 0x61000 bytes 00:04:13.356 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:13.356 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:13.356 EAL: Ask a virtual area of 0x400000000 bytes 00:04:13.356 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:13.356 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:13.356 EAL: Hugepages will be freed exactly as allocated. 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: TSC frequency is ~2700000 KHz 00:04:13.356 EAL: Main lcore 0 is ready (tid=7f2c7591aa00;cpuset=[0]) 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 0 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 2MB 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:13.356 EAL: Mem event callback 'spdk:(nil)' registered 00:04:13.356 00:04:13.356 00:04:13.356 CUnit - A unit testing framework for C - Version 2.1-3 00:04:13.356 http://cunit.sourceforge.net/ 00:04:13.356 00:04:13.356 00:04:13.356 Suite: components_suite 00:04:13.356 Test: vtophys_malloc_test ...passed 00:04:13.356 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 4MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 4MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 6MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 6MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 10MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 10MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 18MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 18MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 34MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 34MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 66MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 66MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 130MB 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was shrunk by 130MB 00:04:13.356 EAL: Trying to obtain current memory policy. 00:04:13.356 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.356 EAL: Restoring previous memory policy: 4 00:04:13.356 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.356 EAL: request: mp_malloc_sync 00:04:13.356 EAL: No shared files mode enabled, IPC is disabled 00:04:13.356 EAL: Heap on socket 0 was expanded by 258MB 00:04:13.614 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.614 EAL: request: mp_malloc_sync 00:04:13.614 EAL: No shared files mode enabled, IPC is disabled 00:04:13.614 EAL: Heap on socket 0 was shrunk by 258MB 00:04:13.614 EAL: Trying to obtain current memory policy. 00:04:13.614 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.614 EAL: Restoring previous memory policy: 4 00:04:13.614 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.614 EAL: request: mp_malloc_sync 00:04:13.614 EAL: No shared files mode enabled, IPC is disabled 00:04:13.614 EAL: Heap on socket 0 was expanded by 514MB 00:04:13.871 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.871 EAL: request: mp_malloc_sync 00:04:13.871 EAL: No shared files mode enabled, IPC is disabled 00:04:13.871 EAL: Heap on socket 0 was shrunk by 514MB 00:04:13.871 EAL: Trying to obtain current memory policy. 00:04:13.871 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:14.129 EAL: Restoring previous memory policy: 4 00:04:14.129 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.129 EAL: request: mp_malloc_sync 00:04:14.129 EAL: No shared files mode enabled, IPC is disabled 00:04:14.129 EAL: Heap on socket 0 was expanded by 1026MB 00:04:14.387 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.645 EAL: request: mp_malloc_sync 00:04:14.645 EAL: No shared files mode enabled, IPC is disabled 00:04:14.645 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:14.645 passed 00:04:14.645 00:04:14.645 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.645 suites 1 1 n/a 0 0 00:04:14.645 tests 2 2 2 0 0 00:04:14.645 asserts 497 497 497 0 n/a 00:04:14.645 00:04:14.645 Elapsed time = 1.355 seconds 00:04:14.645 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.645 EAL: request: mp_malloc_sync 00:04:14.645 EAL: No shared files mode enabled, IPC is disabled 00:04:14.645 EAL: Heap on socket 0 was shrunk by 2MB 00:04:14.645 EAL: No shared files mode enabled, IPC is disabled 00:04:14.645 EAL: No shared files mode enabled, IPC is disabled 00:04:14.645 EAL: No shared files mode enabled, IPC is disabled 00:04:14.645 00:04:14.645 real 0m1.472s 00:04:14.645 user 0m0.818s 00:04:14.645 sys 0m0.620s 00:04:14.645 07:02:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:14.645 07:02:17 -- common/autotest_common.sh@10 -- # set +x 00:04:14.645 ************************************ 00:04:14.645 END TEST env_vtophys 00:04:14.645 ************************************ 00:04:14.645 07:02:17 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:14.645 07:02:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:14.645 07:02:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:14.645 07:02:17 -- common/autotest_common.sh@10 -- # set +x 00:04:14.645 ************************************ 00:04:14.645 START TEST env_pci 00:04:14.645 ************************************ 00:04:14.645 07:02:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:14.645 00:04:14.645 00:04:14.645 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.645 http://cunit.sourceforge.net/ 00:04:14.645 00:04:14.645 00:04:14.645 Suite: pci 00:04:14.645 Test: pci_hook ...[2024-10-16 07:02:17.478614] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1777898 has claimed it 00:04:14.645 EAL: Cannot find device (10000:00:01.0) 00:04:14.645 EAL: Failed to attach device on primary process 00:04:14.645 passed 00:04:14.645 00:04:14.645 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.645 suites 1 1 n/a 0 0 00:04:14.645 tests 1 1 1 0 0 00:04:14.645 asserts 25 25 25 0 n/a 00:04:14.645 00:04:14.645 Elapsed time = 0.019 seconds 00:04:14.645 00:04:14.645 real 0m0.030s 00:04:14.645 user 0m0.009s 00:04:14.645 sys 0m0.021s 00:04:14.645 07:02:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:14.645 07:02:17 -- common/autotest_common.sh@10 -- # set +x 00:04:14.645 ************************************ 00:04:14.645 END TEST env_pci 00:04:14.645 ************************************ 00:04:14.645 07:02:17 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:14.645 07:02:17 -- env/env.sh@15 -- # uname 00:04:14.645 07:02:17 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:14.645 07:02:17 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:14.645 07:02:17 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:14.645 07:02:17 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:04:14.645 07:02:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:14.645 07:02:17 -- common/autotest_common.sh@10 -- # set +x 00:04:14.645 ************************************ 00:04:14.645 START TEST env_dpdk_post_init 00:04:14.645 ************************************ 00:04:14.645 07:02:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:14.645 EAL: Detected CPU lcores: 48 00:04:14.645 EAL: Detected NUMA nodes: 2 00:04:14.645 EAL: Detected shared linkage of DPDK 00:04:14.645 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:14.645 EAL: Selected IOVA mode 'VA' 00:04:14.645 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.645 EAL: VFIO support initialized 00:04:14.645 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:14.903 EAL: Using IOMMU type 1 (Type 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:14.903 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:15.837 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:19.119 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:19.119 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:19.119 Starting DPDK initialization... 00:04:19.119 Starting SPDK post initialization... 00:04:19.119 SPDK NVMe probe 00:04:19.119 Attaching to 0000:88:00.0 00:04:19.119 Attached to 0000:88:00.0 00:04:19.119 Cleaning up... 00:04:19.119 00:04:19.119 real 0m4.404s 00:04:19.119 user 0m3.276s 00:04:19.119 sys 0m0.180s 00:04:19.119 07:02:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:19.119 07:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:19.119 ************************************ 00:04:19.119 END TEST env_dpdk_post_init 00:04:19.119 ************************************ 00:04:19.119 07:02:21 -- env/env.sh@26 -- # uname 00:04:19.119 07:02:21 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:19.119 07:02:21 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:19.119 07:02:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:19.119 07:02:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:19.119 07:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:19.119 ************************************ 00:04:19.119 START TEST env_mem_callbacks 00:04:19.119 ************************************ 00:04:19.119 07:02:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:19.119 EAL: Detected CPU lcores: 48 00:04:19.119 EAL: Detected NUMA nodes: 2 00:04:19.119 EAL: Detected shared linkage of DPDK 00:04:19.119 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:19.119 EAL: Selected IOVA mode 'VA' 00:04:19.119 EAL: No free 2048 kB hugepages reported on node 1 00:04:19.119 EAL: VFIO support initialized 00:04:19.119 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:19.119 00:04:19.119 00:04:19.119 CUnit - A unit testing framework for C - Version 2.1-3 00:04:19.119 http://cunit.sourceforge.net/ 00:04:19.119 00:04:19.119 00:04:19.119 Suite: memory 00:04:19.119 Test: test ... 00:04:19.119 register 0x200000200000 2097152 00:04:19.119 malloc 3145728 00:04:19.119 register 0x200000400000 4194304 00:04:19.119 buf 0x200000500000 len 3145728 PASSED 00:04:19.119 malloc 64 00:04:19.119 buf 0x2000004fff40 len 64 PASSED 00:04:19.119 malloc 4194304 00:04:19.119 register 0x200000800000 6291456 00:04:19.119 buf 0x200000a00000 len 4194304 PASSED 00:04:19.119 free 0x200000500000 3145728 00:04:19.119 free 0x2000004fff40 64 00:04:19.119 unregister 0x200000400000 4194304 PASSED 00:04:19.119 free 0x200000a00000 4194304 00:04:19.119 unregister 0x200000800000 6291456 PASSED 00:04:19.119 malloc 8388608 00:04:19.119 register 0x200000400000 10485760 00:04:19.119 buf 0x200000600000 len 8388608 PASSED 00:04:19.119 free 0x200000600000 8388608 00:04:19.120 unregister 0x200000400000 10485760 PASSED 00:04:19.120 passed 00:04:19.120 00:04:19.120 Run Summary: Type Total Ran Passed Failed Inactive 00:04:19.120 suites 1 1 n/a 0 0 00:04:19.120 tests 1 1 1 0 0 00:04:19.120 asserts 15 15 15 0 n/a 00:04:19.120 00:04:19.120 Elapsed time = 0.005 seconds 00:04:19.120 00:04:19.120 real 0m0.047s 00:04:19.120 user 0m0.015s 00:04:19.120 sys 0m0.032s 00:04:19.120 07:02:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:19.120 07:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.120 ************************************ 00:04:19.120 END TEST env_mem_callbacks 00:04:19.120 ************************************ 00:04:19.120 00:04:19.120 real 0m6.292s 00:04:19.120 user 0m4.333s 00:04:19.120 sys 0m1.001s 00:04:19.120 07:02:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:19.120 07:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.120 ************************************ 00:04:19.120 END TEST env 00:04:19.120 ************************************ 00:04:19.120 07:02:22 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:19.120 07:02:22 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:19.120 07:02:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:19.120 07:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.120 ************************************ 00:04:19.120 START TEST rpc 00:04:19.120 ************************************ 00:04:19.120 07:02:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:19.378 * Looking for test storage... 00:04:19.378 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:19.378 07:02:22 -- rpc/rpc.sh@65 -- # spdk_pid=1778565 00:04:19.378 07:02:22 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:19.378 07:02:22 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:19.378 07:02:22 -- rpc/rpc.sh@67 -- # waitforlisten 1778565 00:04:19.378 07:02:22 -- common/autotest_common.sh@819 -- # '[' -z 1778565 ']' 00:04:19.378 07:02:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:19.378 07:02:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:19.378 07:02:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:19.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:19.378 07:02:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:19.378 07:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.378 [2024-10-16 07:02:22.148756] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:19.378 [2024-10-16 07:02:22.148854] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1778565 ] 00:04:19.378 EAL: No free 2048 kB hugepages reported on node 1 00:04:19.378 [2024-10-16 07:02:22.203980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:19.378 [2024-10-16 07:02:22.307505] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:19.378 [2024-10-16 07:02:22.307665] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:19.378 [2024-10-16 07:02:22.307681] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1778565' to capture a snapshot of events at runtime. 00:04:19.378 [2024-10-16 07:02:22.307693] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1778565 for offline analysis/debug. 00:04:19.378 [2024-10-16 07:02:22.307754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:20.312 07:02:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:20.312 07:02:23 -- common/autotest_common.sh@852 -- # return 0 00:04:20.312 07:02:23 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:20.312 07:02:23 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:20.312 07:02:23 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:20.312 07:02:23 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:20.312 07:02:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:20.312 07:02:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:20.312 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.312 ************************************ 00:04:20.312 START TEST rpc_integrity 00:04:20.312 ************************************ 00:04:20.312 07:02:23 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:20.312 07:02:23 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:20.312 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.312 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.312 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.312 07:02:23 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:20.312 07:02:23 -- rpc/rpc.sh@13 -- # jq length 00:04:20.312 07:02:23 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:20.312 07:02:23 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:20.312 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.312 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.312 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.312 07:02:23 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:20.312 07:02:23 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:20.312 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.312 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.312 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.312 07:02:23 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:20.312 { 00:04:20.312 "name": "Malloc0", 00:04:20.312 "aliases": [ 00:04:20.312 "57b3e5ab-90a9-4285-aa6e-7a724a9bd548" 00:04:20.312 ], 00:04:20.312 "product_name": "Malloc disk", 00:04:20.312 "block_size": 512, 00:04:20.312 "num_blocks": 16384, 00:04:20.312 "uuid": "57b3e5ab-90a9-4285-aa6e-7a724a9bd548", 00:04:20.312 "assigned_rate_limits": { 00:04:20.312 "rw_ios_per_sec": 0, 00:04:20.312 "rw_mbytes_per_sec": 0, 00:04:20.312 "r_mbytes_per_sec": 0, 00:04:20.312 "w_mbytes_per_sec": 0 00:04:20.312 }, 00:04:20.312 "claimed": false, 00:04:20.312 "zoned": false, 00:04:20.312 "supported_io_types": { 00:04:20.312 "read": true, 00:04:20.312 "write": true, 00:04:20.312 "unmap": true, 00:04:20.312 "write_zeroes": true, 00:04:20.312 "flush": true, 00:04:20.312 "reset": true, 00:04:20.312 "compare": false, 00:04:20.312 "compare_and_write": false, 00:04:20.312 "abort": true, 00:04:20.312 "nvme_admin": false, 00:04:20.312 "nvme_io": false 00:04:20.312 }, 00:04:20.312 "memory_domains": [ 00:04:20.312 { 00:04:20.312 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:20.312 "dma_device_type": 2 00:04:20.312 } 00:04:20.312 ], 00:04:20.312 "driver_specific": {} 00:04:20.312 } 00:04:20.312 ]' 00:04:20.312 07:02:23 -- rpc/rpc.sh@17 -- # jq length 00:04:20.312 07:02:23 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:20.312 07:02:23 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:20.312 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.312 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.312 [2024-10-16 07:02:23.212157] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:20.312 [2024-10-16 07:02:23.212209] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:20.312 [2024-10-16 07:02:23.212235] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xac8cb0 00:04:20.312 [2024-10-16 07:02:23.212250] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:20.312 [2024-10-16 07:02:23.213687] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:20.312 [2024-10-16 07:02:23.213716] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:20.312 Passthru0 00:04:20.313 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.313 07:02:23 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:20.313 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.313 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.313 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.313 07:02:23 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:20.313 { 00:04:20.313 "name": "Malloc0", 00:04:20.313 "aliases": [ 00:04:20.313 "57b3e5ab-90a9-4285-aa6e-7a724a9bd548" 00:04:20.313 ], 00:04:20.313 "product_name": "Malloc disk", 00:04:20.313 "block_size": 512, 00:04:20.313 "num_blocks": 16384, 00:04:20.313 "uuid": "57b3e5ab-90a9-4285-aa6e-7a724a9bd548", 00:04:20.313 "assigned_rate_limits": { 00:04:20.313 "rw_ios_per_sec": 0, 00:04:20.313 "rw_mbytes_per_sec": 0, 00:04:20.313 "r_mbytes_per_sec": 0, 00:04:20.313 "w_mbytes_per_sec": 0 00:04:20.313 }, 00:04:20.313 "claimed": true, 00:04:20.313 "claim_type": "exclusive_write", 00:04:20.313 "zoned": false, 00:04:20.313 "supported_io_types": { 00:04:20.313 "read": true, 00:04:20.313 "write": true, 00:04:20.313 "unmap": true, 00:04:20.313 "write_zeroes": true, 00:04:20.313 "flush": true, 00:04:20.313 "reset": true, 00:04:20.313 "compare": false, 00:04:20.313 "compare_and_write": false, 00:04:20.313 "abort": true, 00:04:20.313 "nvme_admin": false, 00:04:20.313 "nvme_io": false 00:04:20.313 }, 00:04:20.313 "memory_domains": [ 00:04:20.313 { 00:04:20.313 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:20.313 "dma_device_type": 2 00:04:20.313 } 00:04:20.313 ], 00:04:20.313 "driver_specific": {} 00:04:20.313 }, 00:04:20.313 { 00:04:20.313 "name": "Passthru0", 00:04:20.313 "aliases": [ 00:04:20.313 "5273583a-8635-5e6d-8eed-15febda4137c" 00:04:20.313 ], 00:04:20.313 "product_name": "passthru", 00:04:20.313 "block_size": 512, 00:04:20.313 "num_blocks": 16384, 00:04:20.313 "uuid": "5273583a-8635-5e6d-8eed-15febda4137c", 00:04:20.313 "assigned_rate_limits": { 00:04:20.313 "rw_ios_per_sec": 0, 00:04:20.313 "rw_mbytes_per_sec": 0, 00:04:20.313 "r_mbytes_per_sec": 0, 00:04:20.313 "w_mbytes_per_sec": 0 00:04:20.313 }, 00:04:20.313 "claimed": false, 00:04:20.313 "zoned": false, 00:04:20.313 "supported_io_types": { 00:04:20.313 "read": true, 00:04:20.313 "write": true, 00:04:20.313 "unmap": true, 00:04:20.313 "write_zeroes": true, 00:04:20.313 "flush": true, 00:04:20.313 "reset": true, 00:04:20.313 "compare": false, 00:04:20.313 "compare_and_write": false, 00:04:20.313 "abort": true, 00:04:20.313 "nvme_admin": false, 00:04:20.313 "nvme_io": false 00:04:20.313 }, 00:04:20.313 "memory_domains": [ 00:04:20.313 { 00:04:20.313 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:20.313 "dma_device_type": 2 00:04:20.313 } 00:04:20.313 ], 00:04:20.313 "driver_specific": { 00:04:20.313 "passthru": { 00:04:20.313 "name": "Passthru0", 00:04:20.313 "base_bdev_name": "Malloc0" 00:04:20.313 } 00:04:20.313 } 00:04:20.313 } 00:04:20.313 ]' 00:04:20.313 07:02:23 -- rpc/rpc.sh@21 -- # jq length 00:04:20.570 07:02:23 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:20.570 07:02:23 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:20.570 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.570 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.570 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.570 07:02:23 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:20.570 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.570 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.570 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.570 07:02:23 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:20.570 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.570 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.570 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.570 07:02:23 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:20.570 07:02:23 -- rpc/rpc.sh@26 -- # jq length 00:04:20.570 07:02:23 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:20.570 00:04:20.571 real 0m0.232s 00:04:20.571 user 0m0.147s 00:04:20.571 sys 0m0.024s 00:04:20.571 07:02:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 ************************************ 00:04:20.571 END TEST rpc_integrity 00:04:20.571 ************************************ 00:04:20.571 07:02:23 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:20.571 07:02:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:20.571 07:02:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 ************************************ 00:04:20.571 START TEST rpc_plugins 00:04:20.571 ************************************ 00:04:20.571 07:02:23 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:04:20.571 07:02:23 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:20.571 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.571 07:02:23 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:20.571 07:02:23 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:20.571 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.571 07:02:23 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:20.571 { 00:04:20.571 "name": "Malloc1", 00:04:20.571 "aliases": [ 00:04:20.571 "58e761f9-0d98-491a-a778-e2f0b1cc0155" 00:04:20.571 ], 00:04:20.571 "product_name": "Malloc disk", 00:04:20.571 "block_size": 4096, 00:04:20.571 "num_blocks": 256, 00:04:20.571 "uuid": "58e761f9-0d98-491a-a778-e2f0b1cc0155", 00:04:20.571 "assigned_rate_limits": { 00:04:20.571 "rw_ios_per_sec": 0, 00:04:20.571 "rw_mbytes_per_sec": 0, 00:04:20.571 "r_mbytes_per_sec": 0, 00:04:20.571 "w_mbytes_per_sec": 0 00:04:20.571 }, 00:04:20.571 "claimed": false, 00:04:20.571 "zoned": false, 00:04:20.571 "supported_io_types": { 00:04:20.571 "read": true, 00:04:20.571 "write": true, 00:04:20.571 "unmap": true, 00:04:20.571 "write_zeroes": true, 00:04:20.571 "flush": true, 00:04:20.571 "reset": true, 00:04:20.571 "compare": false, 00:04:20.571 "compare_and_write": false, 00:04:20.571 "abort": true, 00:04:20.571 "nvme_admin": false, 00:04:20.571 "nvme_io": false 00:04:20.571 }, 00:04:20.571 "memory_domains": [ 00:04:20.571 { 00:04:20.571 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:20.571 "dma_device_type": 2 00:04:20.571 } 00:04:20.571 ], 00:04:20.571 "driver_specific": {} 00:04:20.571 } 00:04:20.571 ]' 00:04:20.571 07:02:23 -- rpc/rpc.sh@32 -- # jq length 00:04:20.571 07:02:23 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:20.571 07:02:23 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:20.571 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.571 07:02:23 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:20.571 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.571 07:02:23 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:20.571 07:02:23 -- rpc/rpc.sh@36 -- # jq length 00:04:20.571 07:02:23 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:20.571 00:04:20.571 real 0m0.109s 00:04:20.571 user 0m0.073s 00:04:20.571 sys 0m0.008s 00:04:20.571 07:02:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 ************************************ 00:04:20.571 END TEST rpc_plugins 00:04:20.571 ************************************ 00:04:20.571 07:02:23 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:20.571 07:02:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:20.571 07:02:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 ************************************ 00:04:20.571 START TEST rpc_trace_cmd_test 00:04:20.571 ************************************ 00:04:20.571 07:02:23 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:04:20.571 07:02:23 -- rpc/rpc.sh@40 -- # local info 00:04:20.571 07:02:23 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:20.571 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.571 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.571 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.571 07:02:23 -- rpc/rpc.sh@42 -- # info='{ 00:04:20.571 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1778565", 00:04:20.571 "tpoint_group_mask": "0x8", 00:04:20.571 "iscsi_conn": { 00:04:20.571 "mask": "0x2", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "scsi": { 00:04:20.571 "mask": "0x4", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "bdev": { 00:04:20.571 "mask": "0x8", 00:04:20.571 "tpoint_mask": "0xffffffffffffffff" 00:04:20.571 }, 00:04:20.571 "nvmf_rdma": { 00:04:20.571 "mask": "0x10", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "nvmf_tcp": { 00:04:20.571 "mask": "0x20", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "ftl": { 00:04:20.571 "mask": "0x40", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "blobfs": { 00:04:20.571 "mask": "0x80", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "dsa": { 00:04:20.571 "mask": "0x200", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "thread": { 00:04:20.571 "mask": "0x400", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "nvme_pcie": { 00:04:20.571 "mask": "0x800", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "iaa": { 00:04:20.571 "mask": "0x1000", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "nvme_tcp": { 00:04:20.571 "mask": "0x2000", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 }, 00:04:20.571 "bdev_nvme": { 00:04:20.571 "mask": "0x4000", 00:04:20.571 "tpoint_mask": "0x0" 00:04:20.571 } 00:04:20.571 }' 00:04:20.571 07:02:23 -- rpc/rpc.sh@43 -- # jq length 00:04:20.829 07:02:23 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:20.829 07:02:23 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:20.829 07:02:23 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:20.829 07:02:23 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:20.829 07:02:23 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:20.829 07:02:23 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:20.829 07:02:23 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:20.829 07:02:23 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:20.829 07:02:23 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:20.829 00:04:20.829 real 0m0.196s 00:04:20.829 user 0m0.173s 00:04:20.829 sys 0m0.015s 00:04:20.829 07:02:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:20.829 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.829 ************************************ 00:04:20.829 END TEST rpc_trace_cmd_test 00:04:20.829 ************************************ 00:04:20.829 07:02:23 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:20.829 07:02:23 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:20.829 07:02:23 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:20.829 07:02:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:20.829 07:02:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:20.829 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.829 ************************************ 00:04:20.829 START TEST rpc_daemon_integrity 00:04:20.829 ************************************ 00:04:20.829 07:02:23 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:20.829 07:02:23 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:20.829 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.829 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.829 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.829 07:02:23 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:20.829 07:02:23 -- rpc/rpc.sh@13 -- # jq length 00:04:20.829 07:02:23 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:20.829 07:02:23 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:20.829 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.829 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:20.829 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:20.829 07:02:23 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:20.829 07:02:23 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:20.829 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:20.829 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.087 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.087 07:02:23 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:21.087 { 00:04:21.087 "name": "Malloc2", 00:04:21.087 "aliases": [ 00:04:21.087 "15d951f5-f0ed-4e27-b38d-84b2995896c9" 00:04:21.087 ], 00:04:21.087 "product_name": "Malloc disk", 00:04:21.087 "block_size": 512, 00:04:21.087 "num_blocks": 16384, 00:04:21.087 "uuid": "15d951f5-f0ed-4e27-b38d-84b2995896c9", 00:04:21.087 "assigned_rate_limits": { 00:04:21.087 "rw_ios_per_sec": 0, 00:04:21.087 "rw_mbytes_per_sec": 0, 00:04:21.087 "r_mbytes_per_sec": 0, 00:04:21.087 "w_mbytes_per_sec": 0 00:04:21.087 }, 00:04:21.087 "claimed": false, 00:04:21.087 "zoned": false, 00:04:21.087 "supported_io_types": { 00:04:21.087 "read": true, 00:04:21.087 "write": true, 00:04:21.087 "unmap": true, 00:04:21.087 "write_zeroes": true, 00:04:21.087 "flush": true, 00:04:21.087 "reset": true, 00:04:21.087 "compare": false, 00:04:21.087 "compare_and_write": false, 00:04:21.087 "abort": true, 00:04:21.087 "nvme_admin": false, 00:04:21.087 "nvme_io": false 00:04:21.087 }, 00:04:21.087 "memory_domains": [ 00:04:21.087 { 00:04:21.087 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.087 "dma_device_type": 2 00:04:21.087 } 00:04:21.087 ], 00:04:21.087 "driver_specific": {} 00:04:21.087 } 00:04:21.087 ]' 00:04:21.087 07:02:23 -- rpc/rpc.sh@17 -- # jq length 00:04:21.087 07:02:23 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:21.087 07:02:23 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:21.087 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:21.087 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.087 [2024-10-16 07:02:23.817886] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:21.087 [2024-10-16 07:02:23.817929] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:21.087 [2024-10-16 07:02:23.817951] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xaca590 00:04:21.087 [2024-10-16 07:02:23.817964] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:21.087 [2024-10-16 07:02:23.819312] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:21.087 [2024-10-16 07:02:23.819340] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:21.087 Passthru0 00:04:21.087 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.087 07:02:23 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:21.087 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:21.087 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.087 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.087 07:02:23 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:21.087 { 00:04:21.087 "name": "Malloc2", 00:04:21.087 "aliases": [ 00:04:21.087 "15d951f5-f0ed-4e27-b38d-84b2995896c9" 00:04:21.087 ], 00:04:21.087 "product_name": "Malloc disk", 00:04:21.087 "block_size": 512, 00:04:21.087 "num_blocks": 16384, 00:04:21.087 "uuid": "15d951f5-f0ed-4e27-b38d-84b2995896c9", 00:04:21.087 "assigned_rate_limits": { 00:04:21.087 "rw_ios_per_sec": 0, 00:04:21.087 "rw_mbytes_per_sec": 0, 00:04:21.087 "r_mbytes_per_sec": 0, 00:04:21.087 "w_mbytes_per_sec": 0 00:04:21.087 }, 00:04:21.087 "claimed": true, 00:04:21.087 "claim_type": "exclusive_write", 00:04:21.087 "zoned": false, 00:04:21.087 "supported_io_types": { 00:04:21.087 "read": true, 00:04:21.087 "write": true, 00:04:21.087 "unmap": true, 00:04:21.087 "write_zeroes": true, 00:04:21.087 "flush": true, 00:04:21.087 "reset": true, 00:04:21.087 "compare": false, 00:04:21.087 "compare_and_write": false, 00:04:21.087 "abort": true, 00:04:21.087 "nvme_admin": false, 00:04:21.087 "nvme_io": false 00:04:21.087 }, 00:04:21.087 "memory_domains": [ 00:04:21.087 { 00:04:21.088 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.088 "dma_device_type": 2 00:04:21.088 } 00:04:21.088 ], 00:04:21.088 "driver_specific": {} 00:04:21.088 }, 00:04:21.088 { 00:04:21.088 "name": "Passthru0", 00:04:21.088 "aliases": [ 00:04:21.088 "ab37d6fc-a685-5691-bd2e-1afc0962b29a" 00:04:21.088 ], 00:04:21.088 "product_name": "passthru", 00:04:21.088 "block_size": 512, 00:04:21.088 "num_blocks": 16384, 00:04:21.088 "uuid": "ab37d6fc-a685-5691-bd2e-1afc0962b29a", 00:04:21.088 "assigned_rate_limits": { 00:04:21.088 "rw_ios_per_sec": 0, 00:04:21.088 "rw_mbytes_per_sec": 0, 00:04:21.088 "r_mbytes_per_sec": 0, 00:04:21.088 "w_mbytes_per_sec": 0 00:04:21.088 }, 00:04:21.088 "claimed": false, 00:04:21.088 "zoned": false, 00:04:21.088 "supported_io_types": { 00:04:21.088 "read": true, 00:04:21.088 "write": true, 00:04:21.088 "unmap": true, 00:04:21.088 "write_zeroes": true, 00:04:21.088 "flush": true, 00:04:21.088 "reset": true, 00:04:21.088 "compare": false, 00:04:21.088 "compare_and_write": false, 00:04:21.088 "abort": true, 00:04:21.088 "nvme_admin": false, 00:04:21.088 "nvme_io": false 00:04:21.088 }, 00:04:21.088 "memory_domains": [ 00:04:21.088 { 00:04:21.088 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:21.088 "dma_device_type": 2 00:04:21.088 } 00:04:21.088 ], 00:04:21.088 "driver_specific": { 00:04:21.088 "passthru": { 00:04:21.088 "name": "Passthru0", 00:04:21.088 "base_bdev_name": "Malloc2" 00:04:21.088 } 00:04:21.088 } 00:04:21.088 } 00:04:21.088 ]' 00:04:21.088 07:02:23 -- rpc/rpc.sh@21 -- # jq length 00:04:21.088 07:02:23 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:21.088 07:02:23 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:21.088 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:21.088 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.088 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.088 07:02:23 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:21.088 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:21.088 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.088 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.088 07:02:23 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:21.088 07:02:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:21.088 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.088 07:02:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:21.088 07:02:23 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:21.088 07:02:23 -- rpc/rpc.sh@26 -- # jq length 00:04:21.088 07:02:23 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:21.088 00:04:21.088 real 0m0.219s 00:04:21.088 user 0m0.150s 00:04:21.088 sys 0m0.015s 00:04:21.088 07:02:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:21.088 07:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:21.088 ************************************ 00:04:21.088 END TEST rpc_daemon_integrity 00:04:21.088 ************************************ 00:04:21.088 07:02:23 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:21.088 07:02:23 -- rpc/rpc.sh@84 -- # killprocess 1778565 00:04:21.088 07:02:23 -- common/autotest_common.sh@926 -- # '[' -z 1778565 ']' 00:04:21.088 07:02:23 -- common/autotest_common.sh@930 -- # kill -0 1778565 00:04:21.088 07:02:23 -- common/autotest_common.sh@931 -- # uname 00:04:21.088 07:02:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:21.088 07:02:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1778565 00:04:21.088 07:02:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:21.088 07:02:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:21.088 07:02:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1778565' 00:04:21.088 killing process with pid 1778565 00:04:21.088 07:02:23 -- common/autotest_common.sh@945 -- # kill 1778565 00:04:21.088 07:02:23 -- common/autotest_common.sh@950 -- # wait 1778565 00:04:21.654 00:04:21.654 real 0m2.394s 00:04:21.654 user 0m3.030s 00:04:21.654 sys 0m0.586s 00:04:21.654 07:02:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:21.654 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.654 ************************************ 00:04:21.654 END TEST rpc 00:04:21.654 ************************************ 00:04:21.654 07:02:24 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:21.654 07:02:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:21.654 07:02:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:21.654 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.654 ************************************ 00:04:21.654 START TEST rpc_client 00:04:21.654 ************************************ 00:04:21.654 07:02:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:21.654 * Looking for test storage... 00:04:21.654 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:21.654 07:02:24 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:21.654 OK 00:04:21.654 07:02:24 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:21.654 00:04:21.654 real 0m0.065s 00:04:21.654 user 0m0.032s 00:04:21.654 sys 0m0.039s 00:04:21.654 07:02:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:21.654 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.654 ************************************ 00:04:21.654 END TEST rpc_client 00:04:21.654 ************************************ 00:04:21.654 07:02:24 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:21.654 07:02:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:21.654 07:02:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:21.654 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.654 ************************************ 00:04:21.654 START TEST json_config 00:04:21.654 ************************************ 00:04:21.654 07:02:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:21.913 07:02:24 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:21.913 07:02:24 -- nvmf/common.sh@7 -- # uname -s 00:04:21.913 07:02:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:21.913 07:02:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:21.913 07:02:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:21.913 07:02:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:21.913 07:02:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:21.913 07:02:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:21.913 07:02:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:21.913 07:02:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:21.913 07:02:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:21.913 07:02:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:21.913 07:02:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:21.913 07:02:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:21.913 07:02:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:21.913 07:02:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:21.913 07:02:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:21.913 07:02:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:21.913 07:02:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:21.913 07:02:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:21.913 07:02:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:21.913 07:02:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.913 07:02:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.913 07:02:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.913 07:02:24 -- paths/export.sh@5 -- # export PATH 00:04:21.913 07:02:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:21.913 07:02:24 -- nvmf/common.sh@46 -- # : 0 00:04:21.913 07:02:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:21.913 07:02:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:21.913 07:02:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:21.913 07:02:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:21.913 07:02:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:21.913 07:02:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:21.913 07:02:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:21.913 07:02:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:21.913 07:02:24 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:21.913 07:02:24 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:21.913 07:02:24 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:21.913 07:02:24 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:21.913 07:02:24 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:21.913 07:02:24 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:21.913 07:02:24 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:21.913 07:02:24 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:21.913 07:02:24 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:21.913 07:02:24 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:21.913 07:02:24 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:21.913 07:02:24 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:21.913 INFO: JSON configuration test init 00:04:21.913 07:02:24 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:21.913 07:02:24 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:21.913 07:02:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:21.913 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.913 07:02:24 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:21.913 07:02:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:21.913 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.913 07:02:24 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:21.913 07:02:24 -- json_config/json_config.sh@98 -- # local app=target 00:04:21.913 07:02:24 -- json_config/json_config.sh@99 -- # shift 00:04:21.913 07:02:24 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:21.913 07:02:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:21.913 07:02:24 -- json_config/json_config.sh@111 -- # app_pid[$app]=1779042 00:04:21.913 07:02:24 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:21.913 07:02:24 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:21.913 Waiting for target to run... 00:04:21.913 07:02:24 -- json_config/json_config.sh@114 -- # waitforlisten 1779042 /var/tmp/spdk_tgt.sock 00:04:21.913 07:02:24 -- common/autotest_common.sh@819 -- # '[' -z 1779042 ']' 00:04:21.913 07:02:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:21.913 07:02:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:21.913 07:02:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:21.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:21.913 07:02:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:21.913 07:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.913 [2024-10-16 07:02:24.665565] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:21.913 [2024-10-16 07:02:24.665650] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1779042 ] 00:04:21.913 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.480 [2024-10-16 07:02:25.164666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.480 [2024-10-16 07:02:25.269666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:22.480 [2024-10-16 07:02:25.269868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.738 07:02:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:22.738 07:02:25 -- common/autotest_common.sh@852 -- # return 0 00:04:22.738 07:02:25 -- json_config/json_config.sh@115 -- # echo '' 00:04:22.738 00:04:22.738 07:02:25 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:22.738 07:02:25 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:22.738 07:02:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:22.738 07:02:25 -- common/autotest_common.sh@10 -- # set +x 00:04:22.738 07:02:25 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:22.738 07:02:25 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:22.738 07:02:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:22.738 07:02:25 -- common/autotest_common.sh@10 -- # set +x 00:04:22.738 07:02:25 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:22.738 07:02:25 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:22.738 07:02:25 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:26.021 07:02:28 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:26.021 07:02:28 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:26.021 07:02:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:26.021 07:02:28 -- common/autotest_common.sh@10 -- # set +x 00:04:26.021 07:02:28 -- json_config/json_config.sh@48 -- # local ret=0 00:04:26.021 07:02:28 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:26.021 07:02:28 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:26.021 07:02:28 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:26.021 07:02:28 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:26.021 07:02:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:26.280 07:02:29 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:26.280 07:02:29 -- json_config/json_config.sh@51 -- # local get_types 00:04:26.280 07:02:29 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:26.280 07:02:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:26.280 07:02:29 -- common/autotest_common.sh@10 -- # set +x 00:04:26.280 07:02:29 -- json_config/json_config.sh@58 -- # return 0 00:04:26.280 07:02:29 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:26.280 07:02:29 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:26.280 07:02:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:26.280 07:02:29 -- common/autotest_common.sh@10 -- # set +x 00:04:26.280 07:02:29 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:26.280 07:02:29 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:26.280 07:02:29 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:26.280 07:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:26.538 MallocForNvmf0 00:04:26.538 07:02:29 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:26.538 07:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:26.796 MallocForNvmf1 00:04:26.796 07:02:29 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:26.796 07:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:27.054 [2024-10-16 07:02:29.847303] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:27.054 07:02:29 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:27.054 07:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:27.311 07:02:30 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:27.312 07:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:27.569 07:02:30 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:27.569 07:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:27.827 07:02:30 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:27.827 07:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:28.084 [2024-10-16 07:02:30.854754] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:28.085 07:02:30 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:28.085 07:02:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:28.085 07:02:30 -- common/autotest_common.sh@10 -- # set +x 00:04:28.085 07:02:30 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:28.085 07:02:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:28.085 07:02:30 -- common/autotest_common.sh@10 -- # set +x 00:04:28.085 07:02:30 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:28.085 07:02:30 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:28.085 07:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:28.342 MallocBdevForConfigChangeCheck 00:04:28.342 07:02:31 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:28.342 07:02:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:28.342 07:02:31 -- common/autotest_common.sh@10 -- # set +x 00:04:28.342 07:02:31 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:28.342 07:02:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:28.600 07:02:31 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:28.600 INFO: shutting down applications... 00:04:28.600 07:02:31 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:28.600 07:02:31 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:28.600 07:02:31 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:28.600 07:02:31 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:30.499 Calling clear_iscsi_subsystem 00:04:30.499 Calling clear_nvmf_subsystem 00:04:30.499 Calling clear_nbd_subsystem 00:04:30.499 Calling clear_ublk_subsystem 00:04:30.499 Calling clear_vhost_blk_subsystem 00:04:30.499 Calling clear_vhost_scsi_subsystem 00:04:30.499 Calling clear_scheduler_subsystem 00:04:30.499 Calling clear_bdev_subsystem 00:04:30.499 Calling clear_accel_subsystem 00:04:30.499 Calling clear_vmd_subsystem 00:04:30.499 Calling clear_sock_subsystem 00:04:30.499 Calling clear_iobuf_subsystem 00:04:30.499 07:02:33 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:30.499 07:02:33 -- json_config/json_config.sh@396 -- # count=100 00:04:30.499 07:02:33 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:30.499 07:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:30.499 07:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:30.499 07:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:30.757 07:02:33 -- json_config/json_config.sh@398 -- # break 00:04:30.757 07:02:33 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:30.757 07:02:33 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:30.757 07:02:33 -- json_config/json_config.sh@120 -- # local app=target 00:04:30.757 07:02:33 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:30.757 07:02:33 -- json_config/json_config.sh@124 -- # [[ -n 1779042 ]] 00:04:30.757 07:02:33 -- json_config/json_config.sh@127 -- # kill -SIGINT 1779042 00:04:30.757 07:02:33 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:30.757 07:02:33 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:30.757 07:02:33 -- json_config/json_config.sh@130 -- # kill -0 1779042 00:04:30.757 07:02:33 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:31.325 07:02:33 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:31.325 07:02:33 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:31.325 07:02:33 -- json_config/json_config.sh@130 -- # kill -0 1779042 00:04:31.325 07:02:33 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:31.325 07:02:33 -- json_config/json_config.sh@132 -- # break 00:04:31.325 07:02:33 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:31.325 07:02:33 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:31.325 SPDK target shutdown done 00:04:31.325 07:02:33 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:31.325 INFO: relaunching applications... 00:04:31.325 07:02:33 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.325 07:02:34 -- json_config/json_config.sh@98 -- # local app=target 00:04:31.325 07:02:34 -- json_config/json_config.sh@99 -- # shift 00:04:31.325 07:02:34 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:31.325 07:02:34 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:31.325 07:02:34 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:31.325 07:02:34 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:31.325 07:02:34 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:31.325 07:02:34 -- json_config/json_config.sh@111 -- # app_pid[$app]=1780273 00:04:31.325 07:02:34 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:31.325 07:02:34 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:31.325 Waiting for target to run... 00:04:31.325 07:02:34 -- json_config/json_config.sh@114 -- # waitforlisten 1780273 /var/tmp/spdk_tgt.sock 00:04:31.325 07:02:34 -- common/autotest_common.sh@819 -- # '[' -z 1780273 ']' 00:04:31.325 07:02:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:31.325 07:02:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:31.325 07:02:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:31.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:31.325 07:02:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:31.325 07:02:34 -- common/autotest_common.sh@10 -- # set +x 00:04:31.325 [2024-10-16 07:02:34.048380] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:31.325 [2024-10-16 07:02:34.048460] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1780273 ] 00:04:31.325 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.891 [2024-10-16 07:02:34.550468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.891 [2024-10-16 07:02:34.650294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:31.891 [2024-10-16 07:02:34.650495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.170 [2024-10-16 07:02:37.688684] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:35.170 [2024-10-16 07:02:37.721163] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:35.170 07:02:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:35.170 07:02:37 -- common/autotest_common.sh@852 -- # return 0 00:04:35.170 07:02:37 -- json_config/json_config.sh@115 -- # echo '' 00:04:35.170 00:04:35.170 07:02:37 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:35.170 07:02:37 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:35.170 INFO: Checking if target configuration is the same... 00:04:35.170 07:02:37 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:35.170 07:02:37 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:35.170 07:02:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:35.170 + '[' 2 -ne 2 ']' 00:04:35.170 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:35.170 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:35.170 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:35.170 +++ basename /dev/fd/62 00:04:35.170 ++ mktemp /tmp/62.XXX 00:04:35.170 + tmp_file_1=/tmp/62.S94 00:04:35.170 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:35.170 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:35.170 + tmp_file_2=/tmp/spdk_tgt_config.json.nUI 00:04:35.170 + ret=0 00:04:35.170 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:35.429 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:35.688 + diff -u /tmp/62.S94 /tmp/spdk_tgt_config.json.nUI 00:04:35.688 + echo 'INFO: JSON config files are the same' 00:04:35.688 INFO: JSON config files are the same 00:04:35.688 + rm /tmp/62.S94 /tmp/spdk_tgt_config.json.nUI 00:04:35.688 + exit 0 00:04:35.688 07:02:38 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:35.688 07:02:38 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:35.688 INFO: changing configuration and checking if this can be detected... 00:04:35.688 07:02:38 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:35.688 07:02:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:35.688 07:02:38 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:35.688 07:02:38 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:35.688 07:02:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:35.688 + '[' 2 -ne 2 ']' 00:04:35.688 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:35.947 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:35.947 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:35.947 +++ basename /dev/fd/62 00:04:35.947 ++ mktemp /tmp/62.XXX 00:04:35.947 + tmp_file_1=/tmp/62.Q7H 00:04:35.947 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:35.947 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:35.947 + tmp_file_2=/tmp/spdk_tgt_config.json.vfY 00:04:35.947 + ret=0 00:04:35.947 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:36.205 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:36.205 + diff -u /tmp/62.Q7H /tmp/spdk_tgt_config.json.vfY 00:04:36.205 + ret=1 00:04:36.205 + echo '=== Start of file: /tmp/62.Q7H ===' 00:04:36.205 + cat /tmp/62.Q7H 00:04:36.205 + echo '=== End of file: /tmp/62.Q7H ===' 00:04:36.205 + echo '' 00:04:36.205 + echo '=== Start of file: /tmp/spdk_tgt_config.json.vfY ===' 00:04:36.205 + cat /tmp/spdk_tgt_config.json.vfY 00:04:36.205 + echo '=== End of file: /tmp/spdk_tgt_config.json.vfY ===' 00:04:36.205 + echo '' 00:04:36.205 + rm /tmp/62.Q7H /tmp/spdk_tgt_config.json.vfY 00:04:36.205 + exit 1 00:04:36.205 07:02:39 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:36.205 INFO: configuration change detected. 00:04:36.205 07:02:39 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:36.205 07:02:39 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:36.205 07:02:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:36.205 07:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:36.205 07:02:39 -- json_config/json_config.sh@360 -- # local ret=0 00:04:36.205 07:02:39 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:36.205 07:02:39 -- json_config/json_config.sh@370 -- # [[ -n 1780273 ]] 00:04:36.205 07:02:39 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:36.205 07:02:39 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:36.205 07:02:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:36.205 07:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:36.205 07:02:39 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:36.205 07:02:39 -- json_config/json_config.sh@246 -- # uname -s 00:04:36.205 07:02:39 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:36.205 07:02:39 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:36.205 07:02:39 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:36.205 07:02:39 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:36.205 07:02:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:36.205 07:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:36.205 07:02:39 -- json_config/json_config.sh@376 -- # killprocess 1780273 00:04:36.205 07:02:39 -- common/autotest_common.sh@926 -- # '[' -z 1780273 ']' 00:04:36.205 07:02:39 -- common/autotest_common.sh@930 -- # kill -0 1780273 00:04:36.205 07:02:39 -- common/autotest_common.sh@931 -- # uname 00:04:36.205 07:02:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:36.205 07:02:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1780273 00:04:36.464 07:02:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:36.464 07:02:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:36.464 07:02:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1780273' 00:04:36.464 killing process with pid 1780273 00:04:36.464 07:02:39 -- common/autotest_common.sh@945 -- # kill 1780273 00:04:36.464 07:02:39 -- common/autotest_common.sh@950 -- # wait 1780273 00:04:38.367 07:02:40 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:38.367 07:02:40 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:38.367 07:02:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:38.367 07:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:38.367 07:02:40 -- json_config/json_config.sh@381 -- # return 0 00:04:38.367 07:02:40 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:38.367 INFO: Success 00:04:38.367 00:04:38.367 real 0m16.308s 00:04:38.367 user 0m18.720s 00:04:38.367 sys 0m2.227s 00:04:38.367 07:02:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:38.367 07:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:38.367 ************************************ 00:04:38.367 END TEST json_config 00:04:38.367 ************************************ 00:04:38.367 07:02:40 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:38.367 07:02:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:38.367 07:02:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:38.367 07:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:38.367 ************************************ 00:04:38.367 START TEST json_config_extra_key 00:04:38.367 ************************************ 00:04:38.367 07:02:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:38.367 07:02:40 -- nvmf/common.sh@7 -- # uname -s 00:04:38.367 07:02:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:38.367 07:02:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:38.367 07:02:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:38.367 07:02:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:38.367 07:02:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:38.367 07:02:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:38.367 07:02:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:38.367 07:02:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:38.367 07:02:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:38.367 07:02:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:38.367 07:02:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:38.367 07:02:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:38.367 07:02:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:38.367 07:02:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:38.367 07:02:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:38.367 07:02:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:38.367 07:02:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:38.367 07:02:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:38.367 07:02:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:38.367 07:02:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:38.367 07:02:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:38.367 07:02:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:38.367 07:02:40 -- paths/export.sh@5 -- # export PATH 00:04:38.367 07:02:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:38.367 07:02:40 -- nvmf/common.sh@46 -- # : 0 00:04:38.367 07:02:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:38.367 07:02:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:38.367 07:02:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:38.367 07:02:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:38.367 07:02:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:38.367 07:02:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:38.367 07:02:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:38.367 07:02:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:38.367 INFO: launching applications... 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1781300 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:38.367 Waiting for target to run... 00:04:38.367 07:02:40 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1781300 /var/tmp/spdk_tgt.sock 00:04:38.367 07:02:40 -- common/autotest_common.sh@819 -- # '[' -z 1781300 ']' 00:04:38.367 07:02:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:38.367 07:02:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:38.367 07:02:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:38.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:38.367 07:02:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:38.367 07:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:38.367 [2024-10-16 07:02:41.001907] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:38.367 [2024-10-16 07:02:41.001998] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1781300 ] 00:04:38.367 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.626 [2024-10-16 07:02:41.502629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.884 [2024-10-16 07:02:41.602737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.884 [2024-10-16 07:02:41.602927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.142 07:02:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:39.142 07:02:41 -- common/autotest_common.sh@852 -- # return 0 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:39.142 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:39.142 INFO: shutting down applications... 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1781300 ]] 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1781300 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1781300 00:04:39.142 07:02:41 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1781300 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:39.708 SPDK target shutdown done 00:04:39.708 07:02:42 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:39.708 Success 00:04:39.708 00:04:39.708 real 0m1.563s 00:04:39.708 user 0m1.426s 00:04:39.708 sys 0m0.607s 00:04:39.708 07:02:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:39.708 07:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:39.708 ************************************ 00:04:39.708 END TEST json_config_extra_key 00:04:39.708 ************************************ 00:04:39.708 07:02:42 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:39.708 07:02:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:39.708 07:02:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:39.708 07:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:39.708 ************************************ 00:04:39.708 START TEST alias_rpc 00:04:39.708 ************************************ 00:04:39.708 07:02:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:39.708 * Looking for test storage... 00:04:39.708 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:39.708 07:02:42 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:39.708 07:02:42 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1781516 00:04:39.708 07:02:42 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:39.708 07:02:42 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1781516 00:04:39.708 07:02:42 -- common/autotest_common.sh@819 -- # '[' -z 1781516 ']' 00:04:39.708 07:02:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.708 07:02:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:39.708 07:02:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.708 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.708 07:02:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:39.708 07:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:39.708 [2024-10-16 07:02:42.589956] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:39.708 [2024-10-16 07:02:42.590061] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1781516 ] 00:04:39.708 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.966 [2024-10-16 07:02:42.651581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.966 [2024-10-16 07:02:42.758490] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.967 [2024-10-16 07:02:42.758661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.901 07:02:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:40.901 07:02:43 -- common/autotest_common.sh@852 -- # return 0 00:04:40.901 07:02:43 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:40.901 07:02:43 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1781516 00:04:40.901 07:02:43 -- common/autotest_common.sh@926 -- # '[' -z 1781516 ']' 00:04:40.901 07:02:43 -- common/autotest_common.sh@930 -- # kill -0 1781516 00:04:40.901 07:02:43 -- common/autotest_common.sh@931 -- # uname 00:04:40.901 07:02:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:40.901 07:02:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1781516 00:04:41.160 07:02:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:41.160 07:02:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:41.160 07:02:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1781516' 00:04:41.160 killing process with pid 1781516 00:04:41.160 07:02:43 -- common/autotest_common.sh@945 -- # kill 1781516 00:04:41.160 07:02:43 -- common/autotest_common.sh@950 -- # wait 1781516 00:04:41.418 00:04:41.418 real 0m1.831s 00:04:41.418 user 0m2.123s 00:04:41.418 sys 0m0.472s 00:04:41.418 07:02:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:41.418 07:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:41.418 ************************************ 00:04:41.418 END TEST alias_rpc 00:04:41.418 ************************************ 00:04:41.418 07:02:44 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:04:41.418 07:02:44 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:41.418 07:02:44 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:41.418 07:02:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:41.418 07:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:41.418 ************************************ 00:04:41.418 START TEST spdkcli_tcp 00:04:41.418 ************************************ 00:04:41.418 07:02:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:41.677 * Looking for test storage... 00:04:41.677 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:41.677 07:02:44 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:41.677 07:02:44 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:41.677 07:02:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:41.677 07:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1781839 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:41.677 07:02:44 -- spdkcli/tcp.sh@27 -- # waitforlisten 1781839 00:04:41.677 07:02:44 -- common/autotest_common.sh@819 -- # '[' -z 1781839 ']' 00:04:41.677 07:02:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.677 07:02:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:41.677 07:02:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.677 07:02:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:41.677 07:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:41.677 [2024-10-16 07:02:44.447958] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:41.677 [2024-10-16 07:02:44.448051] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1781839 ] 00:04:41.677 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.677 [2024-10-16 07:02:44.504450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:41.677 [2024-10-16 07:02:44.609276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.677 [2024-10-16 07:02:44.609500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:41.677 [2024-10-16 07:02:44.609505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.611 07:02:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:42.612 07:02:45 -- common/autotest_common.sh@852 -- # return 0 00:04:42.612 07:02:45 -- spdkcli/tcp.sh@31 -- # socat_pid=1781879 00:04:42.612 07:02:45 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:42.612 07:02:45 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:42.870 [ 00:04:42.870 "bdev_malloc_delete", 00:04:42.870 "bdev_malloc_create", 00:04:42.870 "bdev_null_resize", 00:04:42.870 "bdev_null_delete", 00:04:42.870 "bdev_null_create", 00:04:42.870 "bdev_nvme_cuse_unregister", 00:04:42.870 "bdev_nvme_cuse_register", 00:04:42.870 "bdev_opal_new_user", 00:04:42.870 "bdev_opal_set_lock_state", 00:04:42.870 "bdev_opal_delete", 00:04:42.870 "bdev_opal_get_info", 00:04:42.870 "bdev_opal_create", 00:04:42.870 "bdev_nvme_opal_revert", 00:04:42.870 "bdev_nvme_opal_init", 00:04:42.870 "bdev_nvme_send_cmd", 00:04:42.870 "bdev_nvme_get_path_iostat", 00:04:42.870 "bdev_nvme_get_mdns_discovery_info", 00:04:42.870 "bdev_nvme_stop_mdns_discovery", 00:04:42.870 "bdev_nvme_start_mdns_discovery", 00:04:42.870 "bdev_nvme_set_multipath_policy", 00:04:42.870 "bdev_nvme_set_preferred_path", 00:04:42.870 "bdev_nvme_get_io_paths", 00:04:42.870 "bdev_nvme_remove_error_injection", 00:04:42.870 "bdev_nvme_add_error_injection", 00:04:42.870 "bdev_nvme_get_discovery_info", 00:04:42.870 "bdev_nvme_stop_discovery", 00:04:42.870 "bdev_nvme_start_discovery", 00:04:42.870 "bdev_nvme_get_controller_health_info", 00:04:42.870 "bdev_nvme_disable_controller", 00:04:42.870 "bdev_nvme_enable_controller", 00:04:42.870 "bdev_nvme_reset_controller", 00:04:42.870 "bdev_nvme_get_transport_statistics", 00:04:42.870 "bdev_nvme_apply_firmware", 00:04:42.870 "bdev_nvme_detach_controller", 00:04:42.870 "bdev_nvme_get_controllers", 00:04:42.870 "bdev_nvme_attach_controller", 00:04:42.870 "bdev_nvme_set_hotplug", 00:04:42.870 "bdev_nvme_set_options", 00:04:42.870 "bdev_passthru_delete", 00:04:42.870 "bdev_passthru_create", 00:04:42.870 "bdev_lvol_grow_lvstore", 00:04:42.870 "bdev_lvol_get_lvols", 00:04:42.870 "bdev_lvol_get_lvstores", 00:04:42.870 "bdev_lvol_delete", 00:04:42.870 "bdev_lvol_set_read_only", 00:04:42.870 "bdev_lvol_resize", 00:04:42.870 "bdev_lvol_decouple_parent", 00:04:42.870 "bdev_lvol_inflate", 00:04:42.870 "bdev_lvol_rename", 00:04:42.870 "bdev_lvol_clone_bdev", 00:04:42.870 "bdev_lvol_clone", 00:04:42.870 "bdev_lvol_snapshot", 00:04:42.870 "bdev_lvol_create", 00:04:42.870 "bdev_lvol_delete_lvstore", 00:04:42.870 "bdev_lvol_rename_lvstore", 00:04:42.870 "bdev_lvol_create_lvstore", 00:04:42.870 "bdev_raid_set_options", 00:04:42.870 "bdev_raid_remove_base_bdev", 00:04:42.870 "bdev_raid_add_base_bdev", 00:04:42.870 "bdev_raid_delete", 00:04:42.870 "bdev_raid_create", 00:04:42.870 "bdev_raid_get_bdevs", 00:04:42.870 "bdev_error_inject_error", 00:04:42.870 "bdev_error_delete", 00:04:42.870 "bdev_error_create", 00:04:42.870 "bdev_split_delete", 00:04:42.870 "bdev_split_create", 00:04:42.870 "bdev_delay_delete", 00:04:42.870 "bdev_delay_create", 00:04:42.870 "bdev_delay_update_latency", 00:04:42.870 "bdev_zone_block_delete", 00:04:42.870 "bdev_zone_block_create", 00:04:42.870 "blobfs_create", 00:04:42.870 "blobfs_detect", 00:04:42.870 "blobfs_set_cache_size", 00:04:42.870 "bdev_aio_delete", 00:04:42.870 "bdev_aio_rescan", 00:04:42.870 "bdev_aio_create", 00:04:42.870 "bdev_ftl_set_property", 00:04:42.870 "bdev_ftl_get_properties", 00:04:42.870 "bdev_ftl_get_stats", 00:04:42.870 "bdev_ftl_unmap", 00:04:42.870 "bdev_ftl_unload", 00:04:42.870 "bdev_ftl_delete", 00:04:42.870 "bdev_ftl_load", 00:04:42.870 "bdev_ftl_create", 00:04:42.870 "bdev_virtio_attach_controller", 00:04:42.870 "bdev_virtio_scsi_get_devices", 00:04:42.870 "bdev_virtio_detach_controller", 00:04:42.871 "bdev_virtio_blk_set_hotplug", 00:04:42.871 "bdev_iscsi_delete", 00:04:42.871 "bdev_iscsi_create", 00:04:42.871 "bdev_iscsi_set_options", 00:04:42.871 "accel_error_inject_error", 00:04:42.871 "ioat_scan_accel_module", 00:04:42.871 "dsa_scan_accel_module", 00:04:42.871 "iaa_scan_accel_module", 00:04:42.871 "iscsi_set_options", 00:04:42.871 "iscsi_get_auth_groups", 00:04:42.871 "iscsi_auth_group_remove_secret", 00:04:42.871 "iscsi_auth_group_add_secret", 00:04:42.871 "iscsi_delete_auth_group", 00:04:42.871 "iscsi_create_auth_group", 00:04:42.871 "iscsi_set_discovery_auth", 00:04:42.871 "iscsi_get_options", 00:04:42.871 "iscsi_target_node_request_logout", 00:04:42.871 "iscsi_target_node_set_redirect", 00:04:42.871 "iscsi_target_node_set_auth", 00:04:42.871 "iscsi_target_node_add_lun", 00:04:42.871 "iscsi_get_connections", 00:04:42.871 "iscsi_portal_group_set_auth", 00:04:42.871 "iscsi_start_portal_group", 00:04:42.871 "iscsi_delete_portal_group", 00:04:42.871 "iscsi_create_portal_group", 00:04:42.871 "iscsi_get_portal_groups", 00:04:42.871 "iscsi_delete_target_node", 00:04:42.871 "iscsi_target_node_remove_pg_ig_maps", 00:04:42.871 "iscsi_target_node_add_pg_ig_maps", 00:04:42.871 "iscsi_create_target_node", 00:04:42.871 "iscsi_get_target_nodes", 00:04:42.871 "iscsi_delete_initiator_group", 00:04:42.871 "iscsi_initiator_group_remove_initiators", 00:04:42.871 "iscsi_initiator_group_add_initiators", 00:04:42.871 "iscsi_create_initiator_group", 00:04:42.871 "iscsi_get_initiator_groups", 00:04:42.871 "nvmf_set_crdt", 00:04:42.871 "nvmf_set_config", 00:04:42.871 "nvmf_set_max_subsystems", 00:04:42.871 "nvmf_subsystem_get_listeners", 00:04:42.871 "nvmf_subsystem_get_qpairs", 00:04:42.871 "nvmf_subsystem_get_controllers", 00:04:42.871 "nvmf_get_stats", 00:04:42.871 "nvmf_get_transports", 00:04:42.871 "nvmf_create_transport", 00:04:42.871 "nvmf_get_targets", 00:04:42.871 "nvmf_delete_target", 00:04:42.871 "nvmf_create_target", 00:04:42.871 "nvmf_subsystem_allow_any_host", 00:04:42.871 "nvmf_subsystem_remove_host", 00:04:42.871 "nvmf_subsystem_add_host", 00:04:42.871 "nvmf_subsystem_remove_ns", 00:04:42.871 "nvmf_subsystem_add_ns", 00:04:42.871 "nvmf_subsystem_listener_set_ana_state", 00:04:42.871 "nvmf_discovery_get_referrals", 00:04:42.871 "nvmf_discovery_remove_referral", 00:04:42.871 "nvmf_discovery_add_referral", 00:04:42.871 "nvmf_subsystem_remove_listener", 00:04:42.871 "nvmf_subsystem_add_listener", 00:04:42.871 "nvmf_delete_subsystem", 00:04:42.871 "nvmf_create_subsystem", 00:04:42.871 "nvmf_get_subsystems", 00:04:42.871 "env_dpdk_get_mem_stats", 00:04:42.871 "nbd_get_disks", 00:04:42.871 "nbd_stop_disk", 00:04:42.871 "nbd_start_disk", 00:04:42.871 "ublk_recover_disk", 00:04:42.871 "ublk_get_disks", 00:04:42.871 "ublk_stop_disk", 00:04:42.871 "ublk_start_disk", 00:04:42.871 "ublk_destroy_target", 00:04:42.871 "ublk_create_target", 00:04:42.871 "virtio_blk_create_transport", 00:04:42.871 "virtio_blk_get_transports", 00:04:42.871 "vhost_controller_set_coalescing", 00:04:42.871 "vhost_get_controllers", 00:04:42.871 "vhost_delete_controller", 00:04:42.871 "vhost_create_blk_controller", 00:04:42.871 "vhost_scsi_controller_remove_target", 00:04:42.871 "vhost_scsi_controller_add_target", 00:04:42.871 "vhost_start_scsi_controller", 00:04:42.871 "vhost_create_scsi_controller", 00:04:42.871 "thread_set_cpumask", 00:04:42.871 "framework_get_scheduler", 00:04:42.871 "framework_set_scheduler", 00:04:42.871 "framework_get_reactors", 00:04:42.871 "thread_get_io_channels", 00:04:42.871 "thread_get_pollers", 00:04:42.871 "thread_get_stats", 00:04:42.871 "framework_monitor_context_switch", 00:04:42.871 "spdk_kill_instance", 00:04:42.871 "log_enable_timestamps", 00:04:42.871 "log_get_flags", 00:04:42.871 "log_clear_flag", 00:04:42.871 "log_set_flag", 00:04:42.871 "log_get_level", 00:04:42.871 "log_set_level", 00:04:42.871 "log_get_print_level", 00:04:42.871 "log_set_print_level", 00:04:42.871 "framework_enable_cpumask_locks", 00:04:42.871 "framework_disable_cpumask_locks", 00:04:42.871 "framework_wait_init", 00:04:42.871 "framework_start_init", 00:04:42.871 "scsi_get_devices", 00:04:42.871 "bdev_get_histogram", 00:04:42.871 "bdev_enable_histogram", 00:04:42.871 "bdev_set_qos_limit", 00:04:42.871 "bdev_set_qd_sampling_period", 00:04:42.871 "bdev_get_bdevs", 00:04:42.871 "bdev_reset_iostat", 00:04:42.871 "bdev_get_iostat", 00:04:42.871 "bdev_examine", 00:04:42.871 "bdev_wait_for_examine", 00:04:42.871 "bdev_set_options", 00:04:42.871 "notify_get_notifications", 00:04:42.871 "notify_get_types", 00:04:42.871 "accel_get_stats", 00:04:42.871 "accel_set_options", 00:04:42.871 "accel_set_driver", 00:04:42.871 "accel_crypto_key_destroy", 00:04:42.871 "accel_crypto_keys_get", 00:04:42.871 "accel_crypto_key_create", 00:04:42.871 "accel_assign_opc", 00:04:42.871 "accel_get_module_info", 00:04:42.871 "accel_get_opc_assignments", 00:04:42.871 "vmd_rescan", 00:04:42.871 "vmd_remove_device", 00:04:42.871 "vmd_enable", 00:04:42.871 "sock_set_default_impl", 00:04:42.871 "sock_impl_set_options", 00:04:42.871 "sock_impl_get_options", 00:04:42.871 "iobuf_get_stats", 00:04:42.871 "iobuf_set_options", 00:04:42.871 "framework_get_pci_devices", 00:04:42.871 "framework_get_config", 00:04:42.871 "framework_get_subsystems", 00:04:42.871 "trace_get_info", 00:04:42.871 "trace_get_tpoint_group_mask", 00:04:42.871 "trace_disable_tpoint_group", 00:04:42.871 "trace_enable_tpoint_group", 00:04:42.871 "trace_clear_tpoint_mask", 00:04:42.871 "trace_set_tpoint_mask", 00:04:42.871 "spdk_get_version", 00:04:42.871 "rpc_get_methods" 00:04:42.871 ] 00:04:42.871 07:02:45 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:42.871 07:02:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:42.871 07:02:45 -- common/autotest_common.sh@10 -- # set +x 00:04:42.871 07:02:45 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:42.871 07:02:45 -- spdkcli/tcp.sh@38 -- # killprocess 1781839 00:04:42.871 07:02:45 -- common/autotest_common.sh@926 -- # '[' -z 1781839 ']' 00:04:42.871 07:02:45 -- common/autotest_common.sh@930 -- # kill -0 1781839 00:04:42.871 07:02:45 -- common/autotest_common.sh@931 -- # uname 00:04:42.871 07:02:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:42.871 07:02:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1781839 00:04:42.871 07:02:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:42.871 07:02:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:42.871 07:02:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1781839' 00:04:42.871 killing process with pid 1781839 00:04:42.871 07:02:45 -- common/autotest_common.sh@945 -- # kill 1781839 00:04:42.871 07:02:45 -- common/autotest_common.sh@950 -- # wait 1781839 00:04:43.437 00:04:43.437 real 0m1.818s 00:04:43.437 user 0m3.522s 00:04:43.437 sys 0m0.502s 00:04:43.437 07:02:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:43.437 07:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:43.437 ************************************ 00:04:43.437 END TEST spdkcli_tcp 00:04:43.437 ************************************ 00:04:43.437 07:02:46 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:43.437 07:02:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:43.437 07:02:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:43.437 07:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:43.437 ************************************ 00:04:43.437 START TEST dpdk_mem_utility 00:04:43.437 ************************************ 00:04:43.437 07:02:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:43.437 * Looking for test storage... 00:04:43.437 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:43.437 07:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:43.437 07:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1782060 00:04:43.437 07:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:43.437 07:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1782060 00:04:43.437 07:02:46 -- common/autotest_common.sh@819 -- # '[' -z 1782060 ']' 00:04:43.437 07:02:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:43.437 07:02:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:43.437 07:02:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:43.437 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:43.437 07:02:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:43.437 07:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:43.437 [2024-10-16 07:02:46.288964] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:43.437 [2024-10-16 07:02:46.289062] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1782060 ] 00:04:43.437 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.437 [2024-10-16 07:02:46.343496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:43.695 [2024-10-16 07:02:46.447680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:43.695 [2024-10-16 07:02:46.447873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.631 07:02:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:44.631 07:02:47 -- common/autotest_common.sh@852 -- # return 0 00:04:44.631 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:44.631 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:44.631 07:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:44.631 07:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:44.631 { 00:04:44.631 "filename": "/tmp/spdk_mem_dump.txt" 00:04:44.631 } 00:04:44.631 07:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:44.631 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:44.631 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:44.631 1 heaps totaling size 814.000000 MiB 00:04:44.631 size: 814.000000 MiB heap id: 0 00:04:44.631 end heaps---------- 00:04:44.631 8 mempools totaling size 598.116089 MiB 00:04:44.631 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:44.631 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:44.631 size: 84.521057 MiB name: bdev_io_1782060 00:04:44.631 size: 51.011292 MiB name: evtpool_1782060 00:04:44.631 size: 50.003479 MiB name: msgpool_1782060 00:04:44.631 size: 21.763794 MiB name: PDU_Pool 00:04:44.631 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:44.631 size: 0.026123 MiB name: Session_Pool 00:04:44.631 end mempools------- 00:04:44.631 6 memzones totaling size 4.142822 MiB 00:04:44.631 size: 1.000366 MiB name: RG_ring_0_1782060 00:04:44.631 size: 1.000366 MiB name: RG_ring_1_1782060 00:04:44.631 size: 1.000366 MiB name: RG_ring_4_1782060 00:04:44.631 size: 1.000366 MiB name: RG_ring_5_1782060 00:04:44.631 size: 0.125366 MiB name: RG_ring_2_1782060 00:04:44.631 size: 0.015991 MiB name: RG_ring_3_1782060 00:04:44.631 end memzones------- 00:04:44.631 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:44.631 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:44.631 list of free elements. size: 12.519348 MiB 00:04:44.631 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:44.631 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:44.631 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:44.631 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:44.631 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:44.631 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:44.631 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:44.631 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:44.631 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:44.631 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:44.631 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:44.631 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:44.631 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:44.631 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:44.631 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:44.631 list of standard malloc elements. size: 199.218079 MiB 00:04:44.631 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:44.631 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:44.631 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:44.631 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:44.631 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:44.631 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:44.631 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:44.631 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:44.631 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:44.631 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:44.631 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:44.631 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:44.631 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:44.631 list of memzone associated elements. size: 602.262573 MiB 00:04:44.631 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:44.631 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:44.631 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:44.631 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:44.631 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:44.631 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1782060_0 00:04:44.631 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:44.631 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1782060_0 00:04:44.631 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:44.631 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1782060_0 00:04:44.631 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:44.631 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:44.631 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:44.631 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:44.631 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:44.631 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1782060 00:04:44.631 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:44.631 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1782060 00:04:44.631 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:44.631 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1782060 00:04:44.631 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:44.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:44.631 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:44.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:44.631 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:44.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:44.631 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:44.631 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:44.631 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:44.631 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1782060 00:04:44.631 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:44.631 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1782060 00:04:44.631 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:44.631 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1782060 00:04:44.631 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:44.631 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1782060 00:04:44.631 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:44.631 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1782060 00:04:44.631 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:44.631 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:44.631 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:44.631 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:44.631 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:44.631 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:44.631 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:44.631 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1782060 00:04:44.631 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:44.631 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:44.631 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:44.631 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:44.631 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:44.631 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1782060 00:04:44.631 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:44.631 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:44.631 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:44.631 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1782060 00:04:44.631 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:44.631 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1782060 00:04:44.631 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:44.631 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:44.632 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:44.632 07:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1782060 00:04:44.632 07:02:47 -- common/autotest_common.sh@926 -- # '[' -z 1782060 ']' 00:04:44.632 07:02:47 -- common/autotest_common.sh@930 -- # kill -0 1782060 00:04:44.632 07:02:47 -- common/autotest_common.sh@931 -- # uname 00:04:44.632 07:02:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:44.632 07:02:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1782060 00:04:44.632 07:02:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:44.632 07:02:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:44.632 07:02:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1782060' 00:04:44.632 killing process with pid 1782060 00:04:44.632 07:02:47 -- common/autotest_common.sh@945 -- # kill 1782060 00:04:44.632 07:02:47 -- common/autotest_common.sh@950 -- # wait 1782060 00:04:45.198 00:04:45.198 real 0m1.653s 00:04:45.198 user 0m1.826s 00:04:45.198 sys 0m0.443s 00:04:45.199 07:02:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.199 07:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:45.199 ************************************ 00:04:45.199 END TEST dpdk_mem_utility 00:04:45.199 ************************************ 00:04:45.199 07:02:47 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:45.199 07:02:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:45.199 07:02:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.199 07:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:45.199 ************************************ 00:04:45.199 START TEST event 00:04:45.199 ************************************ 00:04:45.199 07:02:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:45.199 * Looking for test storage... 00:04:45.199 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:45.199 07:02:47 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:45.199 07:02:47 -- bdev/nbd_common.sh@6 -- # set -e 00:04:45.199 07:02:47 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:45.199 07:02:47 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:04:45.199 07:02:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.199 07:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:45.199 ************************************ 00:04:45.199 START TEST event_perf 00:04:45.199 ************************************ 00:04:45.199 07:02:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:45.199 Running I/O for 1 seconds...[2024-10-16 07:02:47.945834] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:45.199 [2024-10-16 07:02:47.945912] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1782368 ] 00:04:45.199 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.199 [2024-10-16 07:02:48.010316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:45.199 [2024-10-16 07:02:48.128583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.199 [2024-10-16 07:02:48.128635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:45.199 [2024-10-16 07:02:48.128758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:45.199 [2024-10-16 07:02:48.128762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.571 Running I/O for 1 seconds... 00:04:46.571 lcore 0: 228174 00:04:46.571 lcore 1: 228173 00:04:46.571 lcore 2: 228172 00:04:46.571 lcore 3: 228173 00:04:46.571 done. 00:04:46.571 00:04:46.571 real 0m1.320s 00:04:46.571 user 0m4.223s 00:04:46.571 sys 0m0.091s 00:04:46.571 07:02:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:46.571 07:02:49 -- common/autotest_common.sh@10 -- # set +x 00:04:46.571 ************************************ 00:04:46.571 END TEST event_perf 00:04:46.571 ************************************ 00:04:46.571 07:02:49 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:46.571 07:02:49 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:46.571 07:02:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:46.571 07:02:49 -- common/autotest_common.sh@10 -- # set +x 00:04:46.571 ************************************ 00:04:46.571 START TEST event_reactor 00:04:46.571 ************************************ 00:04:46.571 07:02:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:46.571 [2024-10-16 07:02:49.293456] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:46.571 [2024-10-16 07:02:49.293555] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1782537 ] 00:04:46.571 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.571 [2024-10-16 07:02:49.352063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.571 [2024-10-16 07:02:49.468279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.024 test_start 00:04:48.024 oneshot 00:04:48.024 tick 100 00:04:48.024 tick 100 00:04:48.024 tick 250 00:04:48.024 tick 100 00:04:48.024 tick 100 00:04:48.024 tick 100 00:04:48.024 tick 250 00:04:48.024 tick 500 00:04:48.024 tick 100 00:04:48.024 tick 100 00:04:48.024 tick 250 00:04:48.024 tick 100 00:04:48.024 tick 100 00:04:48.024 test_end 00:04:48.024 00:04:48.024 real 0m1.314s 00:04:48.024 user 0m1.228s 00:04:48.024 sys 0m0.080s 00:04:48.024 07:02:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:48.024 07:02:50 -- common/autotest_common.sh@10 -- # set +x 00:04:48.024 ************************************ 00:04:48.024 END TEST event_reactor 00:04:48.024 ************************************ 00:04:48.024 07:02:50 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:48.024 07:02:50 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:48.024 07:02:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:48.024 07:02:50 -- common/autotest_common.sh@10 -- # set +x 00:04:48.024 ************************************ 00:04:48.024 START TEST event_reactor_perf 00:04:48.024 ************************************ 00:04:48.024 07:02:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:48.024 [2024-10-16 07:02:50.634936] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:48.024 [2024-10-16 07:02:50.635010] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1782697 ] 00:04:48.024 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.024 [2024-10-16 07:02:50.696118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.024 [2024-10-16 07:02:50.811384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.399 test_start 00:04:49.399 test_end 00:04:49.399 Performance: 352335 events per second 00:04:49.399 00:04:49.399 real 0m1.314s 00:04:49.399 user 0m1.225s 00:04:49.399 sys 0m0.083s 00:04:49.399 07:02:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:49.399 07:02:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.399 ************************************ 00:04:49.399 END TEST event_reactor_perf 00:04:49.399 ************************************ 00:04:49.399 07:02:51 -- event/event.sh@49 -- # uname -s 00:04:49.399 07:02:51 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:49.399 07:02:51 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:49.399 07:02:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:49.399 07:02:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:49.399 07:02:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.399 ************************************ 00:04:49.399 START TEST event_scheduler 00:04:49.399 ************************************ 00:04:49.399 07:02:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:49.399 * Looking for test storage... 00:04:49.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:49.399 07:02:52 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:49.399 07:02:52 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1782882 00:04:49.399 07:02:52 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:49.399 07:02:52 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:49.399 07:02:52 -- scheduler/scheduler.sh@37 -- # waitforlisten 1782882 00:04:49.399 07:02:52 -- common/autotest_common.sh@819 -- # '[' -z 1782882 ']' 00:04:49.399 07:02:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:49.399 07:02:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:49.399 07:02:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:49.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:49.400 07:02:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:49.400 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.400 [2024-10-16 07:02:52.052692] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:49.400 [2024-10-16 07:02:52.052812] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1782882 ] 00:04:49.400 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.400 [2024-10-16 07:02:52.109143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:49.400 [2024-10-16 07:02:52.222951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.400 [2024-10-16 07:02:52.223010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:49.400 [2024-10-16 07:02:52.223013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:49.400 [2024-10-16 07:02:52.222985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:49.400 07:02:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:49.400 07:02:52 -- common/autotest_common.sh@852 -- # return 0 00:04:49.400 07:02:52 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:49.400 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.400 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.400 POWER: Env isn't set yet! 00:04:49.400 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:49.400 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:49.400 POWER: Cannot get available frequencies of lcore 0 00:04:49.400 POWER: Attempting to initialise PSTAT power management... 00:04:49.400 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:49.400 POWER: Initialized successfully for lcore 0 power management 00:04:49.400 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:49.400 POWER: Initialized successfully for lcore 1 power management 00:04:49.400 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:49.400 POWER: Initialized successfully for lcore 2 power management 00:04:49.400 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:49.400 POWER: Initialized successfully for lcore 3 power management 00:04:49.400 [2024-10-16 07:02:52.320929] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:49.400 [2024-10-16 07:02:52.320947] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:49.400 [2024-10-16 07:02:52.320957] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:49.400 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.400 07:02:52 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:49.400 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.400 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 [2024-10-16 07:02:52.426794] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:49.659 07:02:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:49.659 07:02:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 ************************************ 00:04:49.659 START TEST scheduler_create_thread 00:04:49.659 ************************************ 00:04:49.659 07:02:52 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 2 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 3 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 4 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 5 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 6 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 7 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 8 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 9 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 10 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:49.659 07:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:49.659 07:02:52 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:49.659 07:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.659 07:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:50.225 07:02:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:50.225 07:02:53 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:50.225 07:02:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:50.225 07:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:51.598 07:02:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:51.598 07:02:54 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:51.598 07:02:54 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:51.598 07:02:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:51.598 07:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:52.971 07:02:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:52.971 00:04:52.971 real 0m3.101s 00:04:52.971 user 0m0.011s 00:04:52.971 sys 0m0.005s 00:04:52.971 07:02:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:52.971 07:02:55 -- common/autotest_common.sh@10 -- # set +x 00:04:52.971 ************************************ 00:04:52.971 END TEST scheduler_create_thread 00:04:52.971 ************************************ 00:04:52.971 07:02:55 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:52.971 07:02:55 -- scheduler/scheduler.sh@46 -- # killprocess 1782882 00:04:52.971 07:02:55 -- common/autotest_common.sh@926 -- # '[' -z 1782882 ']' 00:04:52.971 07:02:55 -- common/autotest_common.sh@930 -- # kill -0 1782882 00:04:52.971 07:02:55 -- common/autotest_common.sh@931 -- # uname 00:04:52.971 07:02:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:52.971 07:02:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1782882 00:04:52.971 07:02:55 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:52.971 07:02:55 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:52.971 07:02:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1782882' 00:04:52.971 killing process with pid 1782882 00:04:52.971 07:02:55 -- common/autotest_common.sh@945 -- # kill 1782882 00:04:52.971 07:02:55 -- common/autotest_common.sh@950 -- # wait 1782882 00:04:53.228 [2024-10-16 07:02:55.914843] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:53.228 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:53.228 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:53.228 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:53.228 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:53.228 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:53.228 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:53.228 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:53.228 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:53.486 00:04:53.486 real 0m4.233s 00:04:53.486 user 0m6.889s 00:04:53.486 sys 0m0.333s 00:04:53.486 07:02:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:53.486 07:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:53.486 ************************************ 00:04:53.486 END TEST event_scheduler 00:04:53.486 ************************************ 00:04:53.486 07:02:56 -- event/event.sh@51 -- # modprobe -n nbd 00:04:53.486 07:02:56 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:53.486 07:02:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:53.486 07:02:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:53.486 07:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:53.486 ************************************ 00:04:53.486 START TEST app_repeat 00:04:53.486 ************************************ 00:04:53.486 07:02:56 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:04:53.486 07:02:56 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.486 07:02:56 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.486 07:02:56 -- event/event.sh@13 -- # local nbd_list 00:04:53.486 07:02:56 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.486 07:02:56 -- event/event.sh@14 -- # local bdev_list 00:04:53.486 07:02:56 -- event/event.sh@15 -- # local repeat_times=4 00:04:53.486 07:02:56 -- event/event.sh@17 -- # modprobe nbd 00:04:53.486 07:02:56 -- event/event.sh@19 -- # repeat_pid=1783473 00:04:53.486 07:02:56 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:53.486 07:02:56 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:53.486 07:02:56 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1783473' 00:04:53.486 Process app_repeat pid: 1783473 00:04:53.486 07:02:56 -- event/event.sh@23 -- # for i in {0..2} 00:04:53.486 07:02:56 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:53.486 spdk_app_start Round 0 00:04:53.486 07:02:56 -- event/event.sh@25 -- # waitforlisten 1783473 /var/tmp/spdk-nbd.sock 00:04:53.486 07:02:56 -- common/autotest_common.sh@819 -- # '[' -z 1783473 ']' 00:04:53.486 07:02:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:53.487 07:02:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:53.487 07:02:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:53.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:53.487 07:02:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:53.487 07:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:53.487 [2024-10-16 07:02:56.255696] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:04:53.487 [2024-10-16 07:02:56.255816] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1783473 ] 00:04:53.487 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.487 [2024-10-16 07:02:56.319020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:53.745 [2024-10-16 07:02:56.434499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.745 [2024-10-16 07:02:56.434500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.311 07:02:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:54.311 07:02:57 -- common/autotest_common.sh@852 -- # return 0 00:04:54.311 07:02:57 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:54.568 Malloc0 00:04:54.568 07:02:57 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:54.826 Malloc1 00:04:54.826 07:02:57 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@12 -- # local i 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:54.826 07:02:57 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:55.083 /dev/nbd0 00:04:55.341 07:02:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:55.341 07:02:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:55.341 07:02:58 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:55.341 07:02:58 -- common/autotest_common.sh@857 -- # local i 00:04:55.341 07:02:58 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:55.341 07:02:58 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:55.341 07:02:58 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:55.341 07:02:58 -- common/autotest_common.sh@861 -- # break 00:04:55.341 07:02:58 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:55.341 07:02:58 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:55.341 07:02:58 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:55.341 1+0 records in 00:04:55.341 1+0 records out 00:04:55.341 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206961 s, 19.8 MB/s 00:04:55.341 07:02:58 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.341 07:02:58 -- common/autotest_common.sh@874 -- # size=4096 00:04:55.341 07:02:58 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.341 07:02:58 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:55.341 07:02:58 -- common/autotest_common.sh@877 -- # return 0 00:04:55.341 07:02:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:55.341 07:02:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:55.341 07:02:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:55.598 /dev/nbd1 00:04:55.598 07:02:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:55.598 07:02:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:55.598 07:02:58 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:55.598 07:02:58 -- common/autotest_common.sh@857 -- # local i 00:04:55.598 07:02:58 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:55.598 07:02:58 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:55.598 07:02:58 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:55.598 07:02:58 -- common/autotest_common.sh@861 -- # break 00:04:55.598 07:02:58 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:55.598 07:02:58 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:55.598 07:02:58 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:55.598 1+0 records in 00:04:55.598 1+0 records out 00:04:55.598 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211125 s, 19.4 MB/s 00:04:55.599 07:02:58 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.599 07:02:58 -- common/autotest_common.sh@874 -- # size=4096 00:04:55.599 07:02:58 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.599 07:02:58 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:55.599 07:02:58 -- common/autotest_common.sh@877 -- # return 0 00:04:55.599 07:02:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:55.599 07:02:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:55.599 07:02:58 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:55.599 07:02:58 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.599 07:02:58 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:55.856 07:02:58 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:55.856 { 00:04:55.856 "nbd_device": "/dev/nbd0", 00:04:55.856 "bdev_name": "Malloc0" 00:04:55.856 }, 00:04:55.856 { 00:04:55.856 "nbd_device": "/dev/nbd1", 00:04:55.856 "bdev_name": "Malloc1" 00:04:55.856 } 00:04:55.856 ]' 00:04:55.856 07:02:58 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:55.856 { 00:04:55.856 "nbd_device": "/dev/nbd0", 00:04:55.856 "bdev_name": "Malloc0" 00:04:55.856 }, 00:04:55.856 { 00:04:55.856 "nbd_device": "/dev/nbd1", 00:04:55.857 "bdev_name": "Malloc1" 00:04:55.857 } 00:04:55.857 ]' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:55.857 /dev/nbd1' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:55.857 /dev/nbd1' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@65 -- # count=2 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@95 -- # count=2 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:55.857 256+0 records in 00:04:55.857 256+0 records out 00:04:55.857 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00395057 s, 265 MB/s 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:55.857 256+0 records in 00:04:55.857 256+0 records out 00:04:55.857 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227973 s, 46.0 MB/s 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:55.857 256+0 records in 00:04:55.857 256+0 records out 00:04:55.857 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215823 s, 48.6 MB/s 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@51 -- # local i 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:55.857 07:02:58 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@41 -- # break 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@45 -- # return 0 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:56.115 07:02:58 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@41 -- # break 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@45 -- # return 0 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.373 07:02:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@65 -- # true 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@65 -- # count=0 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@104 -- # count=0 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:56.630 07:02:59 -- bdev/nbd_common.sh@109 -- # return 0 00:04:56.630 07:02:59 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:56.888 07:02:59 -- event/event.sh@35 -- # sleep 3 00:04:57.455 [2024-10-16 07:03:00.095974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:57.455 [2024-10-16 07:03:00.215102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.455 [2024-10-16 07:03:00.215102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:57.455 [2024-10-16 07:03:00.276834] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:57.455 [2024-10-16 07:03:00.276898] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:59.981 07:03:02 -- event/event.sh@23 -- # for i in {0..2} 00:04:59.981 07:03:02 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:59.981 spdk_app_start Round 1 00:04:59.981 07:03:02 -- event/event.sh@25 -- # waitforlisten 1783473 /var/tmp/spdk-nbd.sock 00:04:59.981 07:03:02 -- common/autotest_common.sh@819 -- # '[' -z 1783473 ']' 00:04:59.981 07:03:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:59.981 07:03:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:59.981 07:03:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:59.981 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:59.981 07:03:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:59.981 07:03:02 -- common/autotest_common.sh@10 -- # set +x 00:05:00.239 07:03:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:00.239 07:03:03 -- common/autotest_common.sh@852 -- # return 0 00:05:00.239 07:03:03 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:00.497 Malloc0 00:05:00.497 07:03:03 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:00.755 Malloc1 00:05:00.755 07:03:03 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@12 -- # local i 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:00.755 07:03:03 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:01.013 /dev/nbd0 00:05:01.013 07:03:03 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:01.013 07:03:03 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:01.013 07:03:03 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:01.013 07:03:03 -- common/autotest_common.sh@857 -- # local i 00:05:01.013 07:03:03 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:01.013 07:03:03 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:01.013 07:03:03 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:01.013 07:03:03 -- common/autotest_common.sh@861 -- # break 00:05:01.013 07:03:03 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:01.013 07:03:03 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:01.013 07:03:03 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:01.013 1+0 records in 00:05:01.013 1+0 records out 00:05:01.013 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000174819 s, 23.4 MB/s 00:05:01.013 07:03:03 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:01.013 07:03:03 -- common/autotest_common.sh@874 -- # size=4096 00:05:01.013 07:03:03 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:01.013 07:03:03 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:01.013 07:03:03 -- common/autotest_common.sh@877 -- # return 0 00:05:01.013 07:03:03 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:01.013 07:03:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:01.013 07:03:03 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:01.271 /dev/nbd1 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:01.272 07:03:04 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:01.272 07:03:04 -- common/autotest_common.sh@857 -- # local i 00:05:01.272 07:03:04 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:01.272 07:03:04 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:01.272 07:03:04 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:01.272 07:03:04 -- common/autotest_common.sh@861 -- # break 00:05:01.272 07:03:04 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:01.272 07:03:04 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:01.272 07:03:04 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:01.272 1+0 records in 00:05:01.272 1+0 records out 00:05:01.272 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000212451 s, 19.3 MB/s 00:05:01.272 07:03:04 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:01.272 07:03:04 -- common/autotest_common.sh@874 -- # size=4096 00:05:01.272 07:03:04 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:01.272 07:03:04 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:01.272 07:03:04 -- common/autotest_common.sh@877 -- # return 0 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.272 07:03:04 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:01.530 { 00:05:01.530 "nbd_device": "/dev/nbd0", 00:05:01.530 "bdev_name": "Malloc0" 00:05:01.530 }, 00:05:01.530 { 00:05:01.530 "nbd_device": "/dev/nbd1", 00:05:01.530 "bdev_name": "Malloc1" 00:05:01.530 } 00:05:01.530 ]' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:01.530 { 00:05:01.530 "nbd_device": "/dev/nbd0", 00:05:01.530 "bdev_name": "Malloc0" 00:05:01.530 }, 00:05:01.530 { 00:05:01.530 "nbd_device": "/dev/nbd1", 00:05:01.530 "bdev_name": "Malloc1" 00:05:01.530 } 00:05:01.530 ]' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:01.530 /dev/nbd1' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:01.530 /dev/nbd1' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@65 -- # count=2 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@95 -- # count=2 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:01.530 256+0 records in 00:05:01.530 256+0 records out 00:05:01.530 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0038129 s, 275 MB/s 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:01.530 07:03:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:01.788 256+0 records in 00:05:01.788 256+0 records out 00:05:01.788 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208184 s, 50.4 MB/s 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:01.788 256+0 records in 00:05:01.788 256+0 records out 00:05:01.788 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243151 s, 43.1 MB/s 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:01.788 07:03:04 -- bdev/nbd_common.sh@51 -- # local i 00:05:01.789 07:03:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:01.789 07:03:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:02.046 07:03:04 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:02.046 07:03:04 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:02.046 07:03:04 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@41 -- # break 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@45 -- # return 0 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:02.047 07:03:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@41 -- # break 00:05:02.304 07:03:05 -- bdev/nbd_common.sh@45 -- # return 0 00:05:02.305 07:03:05 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:02.305 07:03:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.305 07:03:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@65 -- # true 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@65 -- # count=0 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@104 -- # count=0 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:02.562 07:03:05 -- bdev/nbd_common.sh@109 -- # return 0 00:05:02.562 07:03:05 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:02.820 07:03:05 -- event/event.sh@35 -- # sleep 3 00:05:03.078 [2024-10-16 07:03:05.919896] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:03.336 [2024-10-16 07:03:06.035822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:03.336 [2024-10-16 07:03:06.035826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.336 [2024-10-16 07:03:06.095086] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:03.336 [2024-10-16 07:03:06.095159] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:05.862 07:03:08 -- event/event.sh@23 -- # for i in {0..2} 00:05:05.863 07:03:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:05.863 spdk_app_start Round 2 00:05:05.863 07:03:08 -- event/event.sh@25 -- # waitforlisten 1783473 /var/tmp/spdk-nbd.sock 00:05:05.863 07:03:08 -- common/autotest_common.sh@819 -- # '[' -z 1783473 ']' 00:05:05.863 07:03:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:05.863 07:03:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:05.863 07:03:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:05.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:05.863 07:03:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:05.863 07:03:08 -- common/autotest_common.sh@10 -- # set +x 00:05:06.121 07:03:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:06.121 07:03:08 -- common/autotest_common.sh@852 -- # return 0 00:05:06.121 07:03:08 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:06.385 Malloc0 00:05:06.385 07:03:09 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:06.647 Malloc1 00:05:06.647 07:03:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@12 -- # local i 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.647 07:03:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:06.904 /dev/nbd0 00:05:06.905 07:03:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:06.905 07:03:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:06.905 07:03:09 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:06.905 07:03:09 -- common/autotest_common.sh@857 -- # local i 00:05:06.905 07:03:09 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:06.905 07:03:09 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:06.905 07:03:09 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:06.905 07:03:09 -- common/autotest_common.sh@861 -- # break 00:05:06.905 07:03:09 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:06.905 07:03:09 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:06.905 07:03:09 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:06.905 1+0 records in 00:05:06.905 1+0 records out 00:05:06.905 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000231806 s, 17.7 MB/s 00:05:06.905 07:03:09 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.905 07:03:09 -- common/autotest_common.sh@874 -- # size=4096 00:05:06.905 07:03:09 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.905 07:03:09 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:06.905 07:03:09 -- common/autotest_common.sh@877 -- # return 0 00:05:06.905 07:03:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:06.905 07:03:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.905 07:03:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:07.162 /dev/nbd1 00:05:07.162 07:03:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:07.162 07:03:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:07.162 07:03:10 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:07.163 07:03:10 -- common/autotest_common.sh@857 -- # local i 00:05:07.163 07:03:10 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:07.163 07:03:10 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:07.163 07:03:10 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:07.163 07:03:10 -- common/autotest_common.sh@861 -- # break 00:05:07.163 07:03:10 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:07.163 07:03:10 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:07.163 07:03:10 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:07.163 1+0 records in 00:05:07.163 1+0 records out 00:05:07.163 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000176667 s, 23.2 MB/s 00:05:07.163 07:03:10 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:07.163 07:03:10 -- common/autotest_common.sh@874 -- # size=4096 00:05:07.163 07:03:10 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:07.163 07:03:10 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:07.163 07:03:10 -- common/autotest_common.sh@877 -- # return 0 00:05:07.163 07:03:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:07.163 07:03:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:07.163 07:03:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:07.163 07:03:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.163 07:03:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:07.420 07:03:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:07.420 { 00:05:07.420 "nbd_device": "/dev/nbd0", 00:05:07.420 "bdev_name": "Malloc0" 00:05:07.420 }, 00:05:07.420 { 00:05:07.420 "nbd_device": "/dev/nbd1", 00:05:07.420 "bdev_name": "Malloc1" 00:05:07.420 } 00:05:07.420 ]' 00:05:07.420 07:03:10 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:07.420 { 00:05:07.421 "nbd_device": "/dev/nbd0", 00:05:07.421 "bdev_name": "Malloc0" 00:05:07.421 }, 00:05:07.421 { 00:05:07.421 "nbd_device": "/dev/nbd1", 00:05:07.421 "bdev_name": "Malloc1" 00:05:07.421 } 00:05:07.421 ]' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:07.421 /dev/nbd1' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:07.421 /dev/nbd1' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@65 -- # count=2 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@95 -- # count=2 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:07.421 256+0 records in 00:05:07.421 256+0 records out 00:05:07.421 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00492596 s, 213 MB/s 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:07.421 07:03:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:07.679 256+0 records in 00:05:07.679 256+0 records out 00:05:07.679 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208733 s, 50.2 MB/s 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:07.679 256+0 records in 00:05:07.679 256+0 records out 00:05:07.679 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239874 s, 43.7 MB/s 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@51 -- # local i 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:07.679 07:03:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@41 -- # break 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@45 -- # return 0 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:07.937 07:03:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@41 -- # break 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@45 -- # return 0 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.194 07:03:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@65 -- # true 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@65 -- # count=0 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@104 -- # count=0 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:08.452 07:03:11 -- bdev/nbd_common.sh@109 -- # return 0 00:05:08.452 07:03:11 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:08.710 07:03:11 -- event/event.sh@35 -- # sleep 3 00:05:08.967 [2024-10-16 07:03:11.827220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:09.225 [2024-10-16 07:03:11.941182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.225 [2024-10-16 07:03:11.941183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:09.225 [2024-10-16 07:03:12.003093] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:09.225 [2024-10-16 07:03:12.003195] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:11.752 07:03:14 -- event/event.sh@38 -- # waitforlisten 1783473 /var/tmp/spdk-nbd.sock 00:05:11.752 07:03:14 -- common/autotest_common.sh@819 -- # '[' -z 1783473 ']' 00:05:11.752 07:03:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:11.752 07:03:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:11.752 07:03:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:11.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:11.752 07:03:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:11.752 07:03:14 -- common/autotest_common.sh@10 -- # set +x 00:05:12.010 07:03:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:12.010 07:03:14 -- common/autotest_common.sh@852 -- # return 0 00:05:12.010 07:03:14 -- event/event.sh@39 -- # killprocess 1783473 00:05:12.010 07:03:14 -- common/autotest_common.sh@926 -- # '[' -z 1783473 ']' 00:05:12.010 07:03:14 -- common/autotest_common.sh@930 -- # kill -0 1783473 00:05:12.010 07:03:14 -- common/autotest_common.sh@931 -- # uname 00:05:12.010 07:03:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:12.010 07:03:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1783473 00:05:12.010 07:03:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:12.010 07:03:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:12.010 07:03:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1783473' 00:05:12.010 killing process with pid 1783473 00:05:12.010 07:03:14 -- common/autotest_common.sh@945 -- # kill 1783473 00:05:12.010 07:03:14 -- common/autotest_common.sh@950 -- # wait 1783473 00:05:12.268 spdk_app_start is called in Round 0. 00:05:12.268 Shutdown signal received, stop current app iteration 00:05:12.268 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:05:12.268 spdk_app_start is called in Round 1. 00:05:12.268 Shutdown signal received, stop current app iteration 00:05:12.268 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:05:12.268 spdk_app_start is called in Round 2. 00:05:12.268 Shutdown signal received, stop current app iteration 00:05:12.268 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:05:12.268 spdk_app_start is called in Round 3. 00:05:12.268 Shutdown signal received, stop current app iteration 00:05:12.268 07:03:15 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:12.268 07:03:15 -- event/event.sh@42 -- # return 0 00:05:12.268 00:05:12.268 real 0m18.877s 00:05:12.268 user 0m41.158s 00:05:12.268 sys 0m3.137s 00:05:12.268 07:03:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.268 07:03:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.268 ************************************ 00:05:12.268 END TEST app_repeat 00:05:12.268 ************************************ 00:05:12.268 07:03:15 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:12.268 07:03:15 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:12.268 07:03:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:12.268 07:03:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:12.268 07:03:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.268 ************************************ 00:05:12.268 START TEST cpu_locks 00:05:12.268 ************************************ 00:05:12.268 07:03:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:12.268 * Looking for test storage... 00:05:12.268 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:12.268 07:03:15 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:12.268 07:03:15 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:12.268 07:03:15 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:12.268 07:03:15 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:12.268 07:03:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:12.268 07:03:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:12.268 07:03:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.268 ************************************ 00:05:12.268 START TEST default_locks 00:05:12.268 ************************************ 00:05:12.268 07:03:15 -- common/autotest_common.sh@1104 -- # default_locks 00:05:12.268 07:03:15 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1786637 00:05:12.268 07:03:15 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:12.268 07:03:15 -- event/cpu_locks.sh@47 -- # waitforlisten 1786637 00:05:12.268 07:03:15 -- common/autotest_common.sh@819 -- # '[' -z 1786637 ']' 00:05:12.268 07:03:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.268 07:03:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:12.268 07:03:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.268 07:03:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:12.268 07:03:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.526 [2024-10-16 07:03:15.234704] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:12.526 [2024-10-16 07:03:15.234817] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1786637 ] 00:05:12.526 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.526 [2024-10-16 07:03:15.290685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.526 [2024-10-16 07:03:15.394684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.526 [2024-10-16 07:03:15.394874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.460 07:03:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:13.460 07:03:16 -- common/autotest_common.sh@852 -- # return 0 00:05:13.460 07:03:16 -- event/cpu_locks.sh@49 -- # locks_exist 1786637 00:05:13.460 07:03:16 -- event/cpu_locks.sh@22 -- # lslocks -p 1786637 00:05:13.460 07:03:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:13.718 lslocks: write error 00:05:13.718 07:03:16 -- event/cpu_locks.sh@50 -- # killprocess 1786637 00:05:13.718 07:03:16 -- common/autotest_common.sh@926 -- # '[' -z 1786637 ']' 00:05:13.718 07:03:16 -- common/autotest_common.sh@930 -- # kill -0 1786637 00:05:13.718 07:03:16 -- common/autotest_common.sh@931 -- # uname 00:05:13.718 07:03:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:13.718 07:03:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1786637 00:05:13.718 07:03:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:13.718 07:03:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:13.718 07:03:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1786637' 00:05:13.718 killing process with pid 1786637 00:05:13.718 07:03:16 -- common/autotest_common.sh@945 -- # kill 1786637 00:05:13.718 07:03:16 -- common/autotest_common.sh@950 -- # wait 1786637 00:05:14.283 07:03:16 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1786637 00:05:14.283 07:03:16 -- common/autotest_common.sh@640 -- # local es=0 00:05:14.284 07:03:16 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1786637 00:05:14.284 07:03:16 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:14.284 07:03:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.284 07:03:16 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:14.284 07:03:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:14.284 07:03:16 -- common/autotest_common.sh@643 -- # waitforlisten 1786637 00:05:14.284 07:03:16 -- common/autotest_common.sh@819 -- # '[' -z 1786637 ']' 00:05:14.284 07:03:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.284 07:03:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:14.284 07:03:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.284 07:03:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:14.284 07:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.284 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1786637) - No such process 00:05:14.284 ERROR: process (pid: 1786637) is no longer running 00:05:14.284 07:03:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:14.284 07:03:16 -- common/autotest_common.sh@852 -- # return 1 00:05:14.284 07:03:16 -- common/autotest_common.sh@643 -- # es=1 00:05:14.284 07:03:16 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:14.284 07:03:16 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:14.284 07:03:16 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:14.284 07:03:16 -- event/cpu_locks.sh@54 -- # no_locks 00:05:14.284 07:03:16 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:14.284 07:03:16 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:14.284 07:03:16 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:14.284 00:05:14.284 real 0m1.778s 00:05:14.284 user 0m1.918s 00:05:14.284 sys 0m0.548s 00:05:14.284 07:03:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:14.284 07:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.284 ************************************ 00:05:14.284 END TEST default_locks 00:05:14.284 ************************************ 00:05:14.284 07:03:16 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:14.284 07:03:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:14.284 07:03:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:14.284 07:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.284 ************************************ 00:05:14.284 START TEST default_locks_via_rpc 00:05:14.284 ************************************ 00:05:14.284 07:03:16 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:05:14.284 07:03:16 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1786816 00:05:14.284 07:03:16 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.284 07:03:16 -- event/cpu_locks.sh@63 -- # waitforlisten 1786816 00:05:14.284 07:03:16 -- common/autotest_common.sh@819 -- # '[' -z 1786816 ']' 00:05:14.284 07:03:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.284 07:03:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:14.284 07:03:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.284 07:03:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:14.284 07:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.284 [2024-10-16 07:03:17.042028] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:14.284 [2024-10-16 07:03:17.042122] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1786816 ] 00:05:14.284 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.284 [2024-10-16 07:03:17.101450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.284 [2024-10-16 07:03:17.220626] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.284 [2024-10-16 07:03:17.220832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.216 07:03:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:15.216 07:03:18 -- common/autotest_common.sh@852 -- # return 0 00:05:15.216 07:03:18 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:15.216 07:03:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:15.216 07:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:15.216 07:03:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:15.216 07:03:18 -- event/cpu_locks.sh@67 -- # no_locks 00:05:15.216 07:03:18 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:15.216 07:03:18 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:15.216 07:03:18 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:15.216 07:03:18 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:15.216 07:03:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:15.216 07:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:15.216 07:03:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:15.216 07:03:18 -- event/cpu_locks.sh@71 -- # locks_exist 1786816 00:05:15.216 07:03:18 -- event/cpu_locks.sh@22 -- # lslocks -p 1786816 00:05:15.216 07:03:18 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.474 07:03:18 -- event/cpu_locks.sh@73 -- # killprocess 1786816 00:05:15.474 07:03:18 -- common/autotest_common.sh@926 -- # '[' -z 1786816 ']' 00:05:15.474 07:03:18 -- common/autotest_common.sh@930 -- # kill -0 1786816 00:05:15.474 07:03:18 -- common/autotest_common.sh@931 -- # uname 00:05:15.474 07:03:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:15.474 07:03:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1786816 00:05:15.474 07:03:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:15.474 07:03:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:15.474 07:03:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1786816' 00:05:15.474 killing process with pid 1786816 00:05:15.474 07:03:18 -- common/autotest_common.sh@945 -- # kill 1786816 00:05:15.474 07:03:18 -- common/autotest_common.sh@950 -- # wait 1786816 00:05:16.040 00:05:16.040 real 0m1.817s 00:05:16.040 user 0m2.015s 00:05:16.040 sys 0m0.539s 00:05:16.040 07:03:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.040 07:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:16.040 ************************************ 00:05:16.040 END TEST default_locks_via_rpc 00:05:16.040 ************************************ 00:05:16.040 07:03:18 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:16.040 07:03:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.040 07:03:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.040 07:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:16.040 ************************************ 00:05:16.040 START TEST non_locking_app_on_locked_coremask 00:05:16.040 ************************************ 00:05:16.040 07:03:18 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:05:16.040 07:03:18 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1787109 00:05:16.040 07:03:18 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:16.040 07:03:18 -- event/cpu_locks.sh@81 -- # waitforlisten 1787109 /var/tmp/spdk.sock 00:05:16.040 07:03:18 -- common/autotest_common.sh@819 -- # '[' -z 1787109 ']' 00:05:16.040 07:03:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.040 07:03:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.040 07:03:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.040 07:03:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.040 07:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:16.040 [2024-10-16 07:03:18.887761] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:16.040 [2024-10-16 07:03:18.887865] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1787109 ] 00:05:16.040 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.040 [2024-10-16 07:03:18.949502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.298 [2024-10-16 07:03:19.061642] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.298 [2024-10-16 07:03:19.061836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.232 07:03:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:17.232 07:03:19 -- common/autotest_common.sh@852 -- # return 0 00:05:17.232 07:03:19 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1787249 00:05:17.232 07:03:19 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:17.232 07:03:19 -- event/cpu_locks.sh@85 -- # waitforlisten 1787249 /var/tmp/spdk2.sock 00:05:17.232 07:03:19 -- common/autotest_common.sh@819 -- # '[' -z 1787249 ']' 00:05:17.232 07:03:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:17.232 07:03:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:17.232 07:03:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:17.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:17.232 07:03:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:17.232 07:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:17.232 [2024-10-16 07:03:19.913394] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:17.232 [2024-10-16 07:03:19.913474] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1787249 ] 00:05:17.232 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.232 [2024-10-16 07:03:20.009629] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:17.232 [2024-10-16 07:03:20.009677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.491 [2024-10-16 07:03:20.244168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.491 [2024-10-16 07:03:20.244346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.057 07:03:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:18.057 07:03:20 -- common/autotest_common.sh@852 -- # return 0 00:05:18.057 07:03:20 -- event/cpu_locks.sh@87 -- # locks_exist 1787109 00:05:18.057 07:03:20 -- event/cpu_locks.sh@22 -- # lslocks -p 1787109 00:05:18.057 07:03:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:18.314 lslocks: write error 00:05:18.314 07:03:21 -- event/cpu_locks.sh@89 -- # killprocess 1787109 00:05:18.314 07:03:21 -- common/autotest_common.sh@926 -- # '[' -z 1787109 ']' 00:05:18.314 07:03:21 -- common/autotest_common.sh@930 -- # kill -0 1787109 00:05:18.314 07:03:21 -- common/autotest_common.sh@931 -- # uname 00:05:18.314 07:03:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:18.314 07:03:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1787109 00:05:18.314 07:03:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:18.314 07:03:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:18.314 07:03:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1787109' 00:05:18.314 killing process with pid 1787109 00:05:18.314 07:03:21 -- common/autotest_common.sh@945 -- # kill 1787109 00:05:18.314 07:03:21 -- common/autotest_common.sh@950 -- # wait 1787109 00:05:19.247 07:03:22 -- event/cpu_locks.sh@90 -- # killprocess 1787249 00:05:19.247 07:03:22 -- common/autotest_common.sh@926 -- # '[' -z 1787249 ']' 00:05:19.247 07:03:22 -- common/autotest_common.sh@930 -- # kill -0 1787249 00:05:19.247 07:03:22 -- common/autotest_common.sh@931 -- # uname 00:05:19.247 07:03:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:19.247 07:03:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1787249 00:05:19.505 07:03:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:19.505 07:03:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:19.505 07:03:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1787249' 00:05:19.505 killing process with pid 1787249 00:05:19.505 07:03:22 -- common/autotest_common.sh@945 -- # kill 1787249 00:05:19.505 07:03:22 -- common/autotest_common.sh@950 -- # wait 1787249 00:05:19.807 00:05:19.807 real 0m3.829s 00:05:19.807 user 0m4.213s 00:05:19.807 sys 0m1.067s 00:05:19.807 07:03:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.807 07:03:22 -- common/autotest_common.sh@10 -- # set +x 00:05:19.807 ************************************ 00:05:19.807 END TEST non_locking_app_on_locked_coremask 00:05:19.807 ************************************ 00:05:19.807 07:03:22 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:19.807 07:03:22 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:19.807 07:03:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.807 07:03:22 -- common/autotest_common.sh@10 -- # set +x 00:05:19.807 ************************************ 00:05:19.807 START TEST locking_app_on_unlocked_coremask 00:05:19.807 ************************************ 00:05:19.807 07:03:22 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:05:19.807 07:03:22 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1787566 00:05:19.807 07:03:22 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:19.807 07:03:22 -- event/cpu_locks.sh@99 -- # waitforlisten 1787566 /var/tmp/spdk.sock 00:05:19.807 07:03:22 -- common/autotest_common.sh@819 -- # '[' -z 1787566 ']' 00:05:19.807 07:03:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.807 07:03:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:19.807 07:03:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.807 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.807 07:03:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:19.807 07:03:22 -- common/autotest_common.sh@10 -- # set +x 00:05:20.128 [2024-10-16 07:03:22.744906] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:20.128 [2024-10-16 07:03:22.744989] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1787566 ] 00:05:20.128 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.128 [2024-10-16 07:03:22.810030] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:20.128 [2024-10-16 07:03:22.810072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.128 [2024-10-16 07:03:22.924438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.128 [2024-10-16 07:03:22.924624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.062 07:03:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:21.062 07:03:23 -- common/autotest_common.sh@852 -- # return 0 00:05:21.062 07:03:23 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1787705 00:05:21.062 07:03:23 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:21.062 07:03:23 -- event/cpu_locks.sh@103 -- # waitforlisten 1787705 /var/tmp/spdk2.sock 00:05:21.062 07:03:23 -- common/autotest_common.sh@819 -- # '[' -z 1787705 ']' 00:05:21.062 07:03:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:21.062 07:03:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:21.062 07:03:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:21.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:21.062 07:03:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:21.062 07:03:23 -- common/autotest_common.sh@10 -- # set +x 00:05:21.062 [2024-10-16 07:03:23.744251] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:21.062 [2024-10-16 07:03:23.744331] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1787705 ] 00:05:21.062 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.062 [2024-10-16 07:03:23.836191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.321 [2024-10-16 07:03:24.069263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.321 [2024-10-16 07:03:24.069444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.886 07:03:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:21.886 07:03:24 -- common/autotest_common.sh@852 -- # return 0 00:05:21.886 07:03:24 -- event/cpu_locks.sh@105 -- # locks_exist 1787705 00:05:21.886 07:03:24 -- event/cpu_locks.sh@22 -- # lslocks -p 1787705 00:05:21.886 07:03:24 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:22.144 lslocks: write error 00:05:22.144 07:03:25 -- event/cpu_locks.sh@107 -- # killprocess 1787566 00:05:22.144 07:03:25 -- common/autotest_common.sh@926 -- # '[' -z 1787566 ']' 00:05:22.144 07:03:25 -- common/autotest_common.sh@930 -- # kill -0 1787566 00:05:22.144 07:03:25 -- common/autotest_common.sh@931 -- # uname 00:05:22.144 07:03:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:22.144 07:03:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1787566 00:05:22.144 07:03:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:22.144 07:03:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:22.144 07:03:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1787566' 00:05:22.144 killing process with pid 1787566 00:05:22.144 07:03:25 -- common/autotest_common.sh@945 -- # kill 1787566 00:05:22.144 07:03:25 -- common/autotest_common.sh@950 -- # wait 1787566 00:05:23.078 07:03:25 -- event/cpu_locks.sh@108 -- # killprocess 1787705 00:05:23.078 07:03:25 -- common/autotest_common.sh@926 -- # '[' -z 1787705 ']' 00:05:23.078 07:03:25 -- common/autotest_common.sh@930 -- # kill -0 1787705 00:05:23.078 07:03:25 -- common/autotest_common.sh@931 -- # uname 00:05:23.078 07:03:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:23.078 07:03:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1787705 00:05:23.336 07:03:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:23.336 07:03:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:23.336 07:03:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1787705' 00:05:23.336 killing process with pid 1787705 00:05:23.336 07:03:26 -- common/autotest_common.sh@945 -- # kill 1787705 00:05:23.336 07:03:26 -- common/autotest_common.sh@950 -- # wait 1787705 00:05:23.594 00:05:23.594 real 0m3.778s 00:05:23.594 user 0m4.135s 00:05:23.594 sys 0m1.058s 00:05:23.594 07:03:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:23.594 07:03:26 -- common/autotest_common.sh@10 -- # set +x 00:05:23.594 ************************************ 00:05:23.594 END TEST locking_app_on_unlocked_coremask 00:05:23.594 ************************************ 00:05:23.594 07:03:26 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:23.594 07:03:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.594 07:03:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.594 07:03:26 -- common/autotest_common.sh@10 -- # set +x 00:05:23.594 ************************************ 00:05:23.594 START TEST locking_app_on_locked_coremask 00:05:23.594 ************************************ 00:05:23.594 07:03:26 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:05:23.594 07:03:26 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1788139 00:05:23.594 07:03:26 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:23.594 07:03:26 -- event/cpu_locks.sh@116 -- # waitforlisten 1788139 /var/tmp/spdk.sock 00:05:23.594 07:03:26 -- common/autotest_common.sh@819 -- # '[' -z 1788139 ']' 00:05:23.594 07:03:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:23.594 07:03:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:23.594 07:03:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:23.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:23.594 07:03:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:23.594 07:03:26 -- common/autotest_common.sh@10 -- # set +x 00:05:23.852 [2024-10-16 07:03:26.547762] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:23.852 [2024-10-16 07:03:26.547863] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788139 ] 00:05:23.852 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.852 [2024-10-16 07:03:26.609494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.852 [2024-10-16 07:03:26.730208] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:23.852 [2024-10-16 07:03:26.730396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.789 07:03:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:24.789 07:03:27 -- common/autotest_common.sh@852 -- # return 0 00:05:24.789 07:03:27 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1788276 00:05:24.789 07:03:27 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1788276 /var/tmp/spdk2.sock 00:05:24.789 07:03:27 -- common/autotest_common.sh@640 -- # local es=0 00:05:24.789 07:03:27 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1788276 /var/tmp/spdk2.sock 00:05:24.789 07:03:27 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:24.789 07:03:27 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:24.789 07:03:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:24.789 07:03:27 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:24.789 07:03:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:24.789 07:03:27 -- common/autotest_common.sh@643 -- # waitforlisten 1788276 /var/tmp/spdk2.sock 00:05:24.789 07:03:27 -- common/autotest_common.sh@819 -- # '[' -z 1788276 ']' 00:05:24.789 07:03:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:24.789 07:03:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:24.789 07:03:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:24.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:24.789 07:03:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:24.789 07:03:27 -- common/autotest_common.sh@10 -- # set +x 00:05:24.789 [2024-10-16 07:03:27.589907] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:24.789 [2024-10-16 07:03:27.589999] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788276 ] 00:05:24.789 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.789 [2024-10-16 07:03:27.685684] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1788139 has claimed it. 00:05:24.789 [2024-10-16 07:03:27.685756] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:25.355 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1788276) - No such process 00:05:25.355 ERROR: process (pid: 1788276) is no longer running 00:05:25.355 07:03:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:25.355 07:03:28 -- common/autotest_common.sh@852 -- # return 1 00:05:25.355 07:03:28 -- common/autotest_common.sh@643 -- # es=1 00:05:25.355 07:03:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:25.355 07:03:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:25.355 07:03:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:25.355 07:03:28 -- event/cpu_locks.sh@122 -- # locks_exist 1788139 00:05:25.355 07:03:28 -- event/cpu_locks.sh@22 -- # lslocks -p 1788139 00:05:25.355 07:03:28 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:25.921 lslocks: write error 00:05:25.921 07:03:28 -- event/cpu_locks.sh@124 -- # killprocess 1788139 00:05:25.921 07:03:28 -- common/autotest_common.sh@926 -- # '[' -z 1788139 ']' 00:05:25.921 07:03:28 -- common/autotest_common.sh@930 -- # kill -0 1788139 00:05:25.921 07:03:28 -- common/autotest_common.sh@931 -- # uname 00:05:25.921 07:03:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:25.921 07:03:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1788139 00:05:25.921 07:03:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:25.921 07:03:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:25.921 07:03:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1788139' 00:05:25.921 killing process with pid 1788139 00:05:25.921 07:03:28 -- common/autotest_common.sh@945 -- # kill 1788139 00:05:25.921 07:03:28 -- common/autotest_common.sh@950 -- # wait 1788139 00:05:26.487 00:05:26.487 real 0m2.659s 00:05:26.487 user 0m3.070s 00:05:26.487 sys 0m0.691s 00:05:26.487 07:03:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:26.487 07:03:29 -- common/autotest_common.sh@10 -- # set +x 00:05:26.487 ************************************ 00:05:26.487 END TEST locking_app_on_locked_coremask 00:05:26.487 ************************************ 00:05:26.487 07:03:29 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:26.487 07:03:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:26.487 07:03:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:26.487 07:03:29 -- common/autotest_common.sh@10 -- # set +x 00:05:26.487 ************************************ 00:05:26.487 START TEST locking_overlapped_coremask 00:05:26.487 ************************************ 00:05:26.487 07:03:29 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:05:26.487 07:03:29 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1788452 00:05:26.487 07:03:29 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:26.487 07:03:29 -- event/cpu_locks.sh@133 -- # waitforlisten 1788452 /var/tmp/spdk.sock 00:05:26.487 07:03:29 -- common/autotest_common.sh@819 -- # '[' -z 1788452 ']' 00:05:26.487 07:03:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.487 07:03:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:26.487 07:03:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.487 07:03:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:26.487 07:03:29 -- common/autotest_common.sh@10 -- # set +x 00:05:26.487 [2024-10-16 07:03:29.237112] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:26.487 [2024-10-16 07:03:29.237214] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788452 ] 00:05:26.487 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.487 [2024-10-16 07:03:29.298944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:26.487 [2024-10-16 07:03:29.411519] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.487 [2024-10-16 07:03:29.411751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:26.487 [2024-10-16 07:03:29.411802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:26.487 [2024-10-16 07:03:29.411806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.422 07:03:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:27.422 07:03:30 -- common/autotest_common.sh@852 -- # return 0 00:05:27.422 07:03:30 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1788596 00:05:27.422 07:03:30 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:27.422 07:03:30 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1788596 /var/tmp/spdk2.sock 00:05:27.422 07:03:30 -- common/autotest_common.sh@640 -- # local es=0 00:05:27.422 07:03:30 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1788596 /var/tmp/spdk2.sock 00:05:27.422 07:03:30 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:27.422 07:03:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:27.422 07:03:30 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:27.422 07:03:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:27.422 07:03:30 -- common/autotest_common.sh@643 -- # waitforlisten 1788596 /var/tmp/spdk2.sock 00:05:27.422 07:03:30 -- common/autotest_common.sh@819 -- # '[' -z 1788596 ']' 00:05:27.422 07:03:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:27.422 07:03:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:27.422 07:03:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:27.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:27.422 07:03:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:27.422 07:03:30 -- common/autotest_common.sh@10 -- # set +x 00:05:27.422 [2024-10-16 07:03:30.232863] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:27.422 [2024-10-16 07:03:30.232947] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788596 ] 00:05:27.422 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.422 [2024-10-16 07:03:30.319221] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1788452 has claimed it. 00:05:27.422 [2024-10-16 07:03:30.319292] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:27.988 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1788596) - No such process 00:05:27.988 ERROR: process (pid: 1788596) is no longer running 00:05:27.988 07:03:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:27.988 07:03:30 -- common/autotest_common.sh@852 -- # return 1 00:05:27.988 07:03:30 -- common/autotest_common.sh@643 -- # es=1 00:05:27.988 07:03:30 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:28.246 07:03:30 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:28.246 07:03:30 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:28.246 07:03:30 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:28.246 07:03:30 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:28.246 07:03:30 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:28.246 07:03:30 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:28.246 07:03:30 -- event/cpu_locks.sh@141 -- # killprocess 1788452 00:05:28.246 07:03:30 -- common/autotest_common.sh@926 -- # '[' -z 1788452 ']' 00:05:28.246 07:03:30 -- common/autotest_common.sh@930 -- # kill -0 1788452 00:05:28.246 07:03:30 -- common/autotest_common.sh@931 -- # uname 00:05:28.246 07:03:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:28.246 07:03:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1788452 00:05:28.246 07:03:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:28.246 07:03:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:28.246 07:03:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1788452' 00:05:28.247 killing process with pid 1788452 00:05:28.247 07:03:30 -- common/autotest_common.sh@945 -- # kill 1788452 00:05:28.247 07:03:30 -- common/autotest_common.sh@950 -- # wait 1788452 00:05:28.505 00:05:28.505 real 0m2.234s 00:05:28.505 user 0m6.276s 00:05:28.505 sys 0m0.494s 00:05:28.505 07:03:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.505 07:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.505 ************************************ 00:05:28.505 END TEST locking_overlapped_coremask 00:05:28.505 ************************************ 00:05:28.505 07:03:31 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:28.505 07:03:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:28.505 07:03:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.505 07:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.763 ************************************ 00:05:28.763 START TEST locking_overlapped_coremask_via_rpc 00:05:28.763 ************************************ 00:05:28.763 07:03:31 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:05:28.763 07:03:31 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1788760 00:05:28.763 07:03:31 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:28.763 07:03:31 -- event/cpu_locks.sh@149 -- # waitforlisten 1788760 /var/tmp/spdk.sock 00:05:28.763 07:03:31 -- common/autotest_common.sh@819 -- # '[' -z 1788760 ']' 00:05:28.763 07:03:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.763 07:03:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:28.763 07:03:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.763 07:03:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:28.763 07:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.763 [2024-10-16 07:03:31.499179] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:28.763 [2024-10-16 07:03:31.499273] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788760 ] 00:05:28.763 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.763 [2024-10-16 07:03:31.556110] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:28.763 [2024-10-16 07:03:31.556147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:28.764 [2024-10-16 07:03:31.668591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.764 [2024-10-16 07:03:31.668836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:28.764 [2024-10-16 07:03:31.668903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:28.764 [2024-10-16 07:03:31.668907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.697 07:03:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:29.697 07:03:32 -- common/autotest_common.sh@852 -- # return 0 00:05:29.697 07:03:32 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1788902 00:05:29.697 07:03:32 -- event/cpu_locks.sh@153 -- # waitforlisten 1788902 /var/tmp/spdk2.sock 00:05:29.697 07:03:32 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:29.697 07:03:32 -- common/autotest_common.sh@819 -- # '[' -z 1788902 ']' 00:05:29.697 07:03:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.697 07:03:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:29.697 07:03:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.697 07:03:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:29.697 07:03:32 -- common/autotest_common.sh@10 -- # set +x 00:05:29.698 [2024-10-16 07:03:32.505198] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:29.698 [2024-10-16 07:03:32.505275] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1788902 ] 00:05:29.698 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.698 [2024-10-16 07:03:32.592111] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:29.698 [2024-10-16 07:03:32.592144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:29.956 [2024-10-16 07:03:32.810111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:29.956 [2024-10-16 07:03:32.810342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:29.956 [2024-10-16 07:03:32.813759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:29.956 [2024-10-16 07:03:32.813762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:30.522 07:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:30.522 07:03:33 -- common/autotest_common.sh@852 -- # return 0 00:05:30.522 07:03:33 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:30.522 07:03:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:30.522 07:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:30.522 07:03:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:30.522 07:03:33 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.522 07:03:33 -- common/autotest_common.sh@640 -- # local es=0 00:05:30.522 07:03:33 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.522 07:03:33 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:05:30.522 07:03:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:30.522 07:03:33 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:05:30.522 07:03:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:30.522 07:03:33 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.522 07:03:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:30.522 07:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:30.780 [2024-10-16 07:03:33.473839] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1788760 has claimed it. 00:05:30.780 request: 00:05:30.780 { 00:05:30.780 "method": "framework_enable_cpumask_locks", 00:05:30.780 "req_id": 1 00:05:30.780 } 00:05:30.780 Got JSON-RPC error response 00:05:30.780 response: 00:05:30.780 { 00:05:30.780 "code": -32603, 00:05:30.780 "message": "Failed to claim CPU core: 2" 00:05:30.780 } 00:05:30.780 07:03:33 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:05:30.780 07:03:33 -- common/autotest_common.sh@643 -- # es=1 00:05:30.780 07:03:33 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:30.780 07:03:33 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:30.780 07:03:33 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:30.780 07:03:33 -- event/cpu_locks.sh@158 -- # waitforlisten 1788760 /var/tmp/spdk.sock 00:05:30.780 07:03:33 -- common/autotest_common.sh@819 -- # '[' -z 1788760 ']' 00:05:30.780 07:03:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.780 07:03:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:30.780 07:03:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.780 07:03:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:30.780 07:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.038 07:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:31.038 07:03:33 -- common/autotest_common.sh@852 -- # return 0 00:05:31.038 07:03:33 -- event/cpu_locks.sh@159 -- # waitforlisten 1788902 /var/tmp/spdk2.sock 00:05:31.038 07:03:33 -- common/autotest_common.sh@819 -- # '[' -z 1788902 ']' 00:05:31.038 07:03:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:31.038 07:03:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:31.038 07:03:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:31.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:31.038 07:03:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:31.038 07:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.038 07:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:31.038 07:03:33 -- common/autotest_common.sh@852 -- # return 0 00:05:31.038 07:03:33 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:31.038 07:03:33 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:31.038 07:03:33 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:31.038 07:03:33 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:31.038 00:05:31.038 real 0m2.522s 00:05:31.038 user 0m1.254s 00:05:31.038 sys 0m0.197s 00:05:31.038 07:03:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.038 07:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.038 ************************************ 00:05:31.038 END TEST locking_overlapped_coremask_via_rpc 00:05:31.038 ************************************ 00:05:31.296 07:03:33 -- event/cpu_locks.sh@174 -- # cleanup 00:05:31.296 07:03:33 -- event/cpu_locks.sh@15 -- # [[ -z 1788760 ]] 00:05:31.296 07:03:33 -- event/cpu_locks.sh@15 -- # killprocess 1788760 00:05:31.296 07:03:33 -- common/autotest_common.sh@926 -- # '[' -z 1788760 ']' 00:05:31.296 07:03:33 -- common/autotest_common.sh@930 -- # kill -0 1788760 00:05:31.296 07:03:33 -- common/autotest_common.sh@931 -- # uname 00:05:31.296 07:03:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:31.296 07:03:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1788760 00:05:31.296 07:03:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:31.296 07:03:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:31.296 07:03:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1788760' 00:05:31.296 killing process with pid 1788760 00:05:31.296 07:03:34 -- common/autotest_common.sh@945 -- # kill 1788760 00:05:31.296 07:03:34 -- common/autotest_common.sh@950 -- # wait 1788760 00:05:31.554 07:03:34 -- event/cpu_locks.sh@16 -- # [[ -z 1788902 ]] 00:05:31.554 07:03:34 -- event/cpu_locks.sh@16 -- # killprocess 1788902 00:05:31.554 07:03:34 -- common/autotest_common.sh@926 -- # '[' -z 1788902 ']' 00:05:31.554 07:03:34 -- common/autotest_common.sh@930 -- # kill -0 1788902 00:05:31.554 07:03:34 -- common/autotest_common.sh@931 -- # uname 00:05:31.554 07:03:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:31.554 07:03:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1788902 00:05:31.812 07:03:34 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:31.812 07:03:34 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:31.812 07:03:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1788902' 00:05:31.812 killing process with pid 1788902 00:05:31.812 07:03:34 -- common/autotest_common.sh@945 -- # kill 1788902 00:05:31.812 07:03:34 -- common/autotest_common.sh@950 -- # wait 1788902 00:05:32.071 07:03:34 -- event/cpu_locks.sh@18 -- # rm -f 00:05:32.071 07:03:34 -- event/cpu_locks.sh@1 -- # cleanup 00:05:32.071 07:03:34 -- event/cpu_locks.sh@15 -- # [[ -z 1788760 ]] 00:05:32.071 07:03:34 -- event/cpu_locks.sh@15 -- # killprocess 1788760 00:05:32.071 07:03:34 -- common/autotest_common.sh@926 -- # '[' -z 1788760 ']' 00:05:32.071 07:03:34 -- common/autotest_common.sh@930 -- # kill -0 1788760 00:05:32.071 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1788760) - No such process 00:05:32.071 07:03:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1788760 is not found' 00:05:32.071 Process with pid 1788760 is not found 00:05:32.071 07:03:34 -- event/cpu_locks.sh@16 -- # [[ -z 1788902 ]] 00:05:32.071 07:03:34 -- event/cpu_locks.sh@16 -- # killprocess 1788902 00:05:32.071 07:03:34 -- common/autotest_common.sh@926 -- # '[' -z 1788902 ']' 00:05:32.071 07:03:34 -- common/autotest_common.sh@930 -- # kill -0 1788902 00:05:32.071 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1788902) - No such process 00:05:32.071 07:03:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1788902 is not found' 00:05:32.071 Process with pid 1788902 is not found 00:05:32.071 07:03:34 -- event/cpu_locks.sh@18 -- # rm -f 00:05:32.071 00:05:32.071 real 0m19.839s 00:05:32.071 user 0m35.462s 00:05:32.071 sys 0m5.442s 00:05:32.071 07:03:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:32.071 07:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:32.071 ************************************ 00:05:32.071 END TEST cpu_locks 00:05:32.071 ************************************ 00:05:32.071 00:05:32.071 real 0m47.126s 00:05:32.071 user 1m30.263s 00:05:32.071 sys 0m9.348s 00:05:32.071 07:03:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:32.071 07:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:32.071 ************************************ 00:05:32.071 END TEST event 00:05:32.071 ************************************ 00:05:32.329 07:03:35 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:32.329 07:03:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:32.329 07:03:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:32.329 07:03:35 -- common/autotest_common.sh@10 -- # set +x 00:05:32.329 ************************************ 00:05:32.329 START TEST thread 00:05:32.329 ************************************ 00:05:32.329 07:03:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:32.329 * Looking for test storage... 00:05:32.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:32.329 07:03:35 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:32.329 07:03:35 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:32.329 07:03:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:32.329 07:03:35 -- common/autotest_common.sh@10 -- # set +x 00:05:32.329 ************************************ 00:05:32.329 START TEST thread_poller_perf 00:05:32.329 ************************************ 00:05:32.329 07:03:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:32.329 [2024-10-16 07:03:35.087454] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:32.329 [2024-10-16 07:03:35.087531] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1789274 ] 00:05:32.329 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.329 [2024-10-16 07:03:35.153212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.329 [2024-10-16 07:03:35.268713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.329 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:33.703 [2024-10-16T05:03:36.643Z] ====================================== 00:05:33.703 [2024-10-16T05:03:36.643Z] busy:2714295112 (cyc) 00:05:33.703 [2024-10-16T05:03:36.643Z] total_run_count: 280000 00:05:33.703 [2024-10-16T05:03:36.643Z] tsc_hz: 2700000000 (cyc) 00:05:33.703 [2024-10-16T05:03:36.643Z] ====================================== 00:05:33.703 [2024-10-16T05:03:36.643Z] poller_cost: 9693 (cyc), 3590 (nsec) 00:05:33.703 00:05:33.703 real 0m1.326s 00:05:33.703 user 0m1.227s 00:05:33.703 sys 0m0.092s 00:05:33.703 07:03:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:33.703 07:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:33.703 ************************************ 00:05:33.703 END TEST thread_poller_perf 00:05:33.703 ************************************ 00:05:33.703 07:03:36 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.703 07:03:36 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:33.703 07:03:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:33.703 07:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:33.703 ************************************ 00:05:33.703 START TEST thread_poller_perf 00:05:33.703 ************************************ 00:05:33.703 07:03:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.703 [2024-10-16 07:03:36.440499] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:33.703 [2024-10-16 07:03:36.440583] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1789549 ] 00:05:33.703 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.703 [2024-10-16 07:03:36.502197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.703 [2024-10-16 07:03:36.617181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.703 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:35.076 [2024-10-16T05:03:38.016Z] ====================================== 00:05:35.076 [2024-10-16T05:03:38.016Z] busy:2703796552 (cyc) 00:05:35.076 [2024-10-16T05:03:38.016Z] total_run_count: 3827000 00:05:35.076 [2024-10-16T05:03:38.016Z] tsc_hz: 2700000000 (cyc) 00:05:35.076 [2024-10-16T05:03:38.016Z] ====================================== 00:05:35.076 [2024-10-16T05:03:38.016Z] poller_cost: 706 (cyc), 261 (nsec) 00:05:35.076 00:05:35.076 real 0m1.313s 00:05:35.076 user 0m1.227s 00:05:35.076 sys 0m0.079s 00:05:35.076 07:03:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.076 07:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.076 ************************************ 00:05:35.076 END TEST thread_poller_perf 00:05:35.076 ************************************ 00:05:35.076 07:03:37 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:35.076 00:05:35.076 real 0m2.739s 00:05:35.076 user 0m2.493s 00:05:35.076 sys 0m0.245s 00:05:35.076 07:03:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.076 07:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.076 ************************************ 00:05:35.076 END TEST thread 00:05:35.076 ************************************ 00:05:35.076 07:03:37 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:35.077 07:03:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.077 07:03:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.077 07:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.077 ************************************ 00:05:35.077 START TEST accel 00:05:35.077 ************************************ 00:05:35.077 07:03:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:35.077 * Looking for test storage... 00:05:35.077 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:35.077 07:03:37 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:35.077 07:03:37 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:35.077 07:03:37 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:35.077 07:03:37 -- accel/accel.sh@59 -- # spdk_tgt_pid=1789756 00:05:35.077 07:03:37 -- accel/accel.sh@60 -- # waitforlisten 1789756 00:05:35.077 07:03:37 -- common/autotest_common.sh@819 -- # '[' -z 1789756 ']' 00:05:35.077 07:03:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.077 07:03:37 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:35.077 07:03:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:35.077 07:03:37 -- accel/accel.sh@58 -- # build_accel_config 00:05:35.077 07:03:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.077 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.077 07:03:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.077 07:03:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:35.077 07:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:35.077 07:03:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.077 07:03:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.077 07:03:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.077 07:03:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.077 07:03:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.077 07:03:37 -- accel/accel.sh@42 -- # jq -r . 00:05:35.077 [2024-10-16 07:03:37.878532] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:35.077 [2024-10-16 07:03:37.878624] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1789756 ] 00:05:35.077 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.077 [2024-10-16 07:03:37.935054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.335 [2024-10-16 07:03:38.039655] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:35.335 [2024-10-16 07:03:38.039836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.901 07:03:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:35.901 07:03:38 -- common/autotest_common.sh@852 -- # return 0 00:05:35.901 07:03:38 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:35.901 07:03:38 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:35.901 07:03:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.901 07:03:38 -- common/autotest_common.sh@10 -- # set +x 00:05:35.901 07:03:38 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:35.901 07:03:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # IFS== 00:05:36.159 07:03:38 -- accel/accel.sh@64 -- # read -r opc module 00:05:36.159 07:03:38 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:36.159 07:03:38 -- accel/accel.sh@67 -- # killprocess 1789756 00:05:36.159 07:03:38 -- common/autotest_common.sh@926 -- # '[' -z 1789756 ']' 00:05:36.159 07:03:38 -- common/autotest_common.sh@930 -- # kill -0 1789756 00:05:36.159 07:03:38 -- common/autotest_common.sh@931 -- # uname 00:05:36.159 07:03:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:36.159 07:03:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1789756 00:05:36.159 07:03:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:36.159 07:03:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:36.159 07:03:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1789756' 00:05:36.159 killing process with pid 1789756 00:05:36.159 07:03:38 -- common/autotest_common.sh@945 -- # kill 1789756 00:05:36.159 07:03:38 -- common/autotest_common.sh@950 -- # wait 1789756 00:05:36.418 07:03:39 -- accel/accel.sh@68 -- # trap - ERR 00:05:36.418 07:03:39 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:36.418 07:03:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:36.418 07:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.418 07:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:36.418 07:03:39 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:05:36.418 07:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:36.418 07:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.418 07:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.418 07:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.418 07:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.418 07:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.418 07:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.418 07:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.418 07:03:39 -- accel/accel.sh@42 -- # jq -r . 00:05:36.677 07:03:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.677 07:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:36.677 07:03:39 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:36.677 07:03:39 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:36.677 07:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.677 07:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:36.677 ************************************ 00:05:36.677 START TEST accel_missing_filename 00:05:36.677 ************************************ 00:05:36.677 07:03:39 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:05:36.677 07:03:39 -- common/autotest_common.sh@640 -- # local es=0 00:05:36.677 07:03:39 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:36.677 07:03:39 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:36.677 07:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.677 07:03:39 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:36.677 07:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.677 07:03:39 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:05:36.677 07:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:36.677 07:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.677 07:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.677 07:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.677 07:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.677 07:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.677 07:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.677 07:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.677 07:03:39 -- accel/accel.sh@42 -- # jq -r . 00:05:36.677 [2024-10-16 07:03:39.415319] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:36.677 [2024-10-16 07:03:39.415401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1789929 ] 00:05:36.677 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.677 [2024-10-16 07:03:39.477788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.677 [2024-10-16 07:03:39.594744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.936 [2024-10-16 07:03:39.656866] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:36.936 [2024-10-16 07:03:39.732713] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.936 A filename is required. 00:05:36.936 07:03:39 -- common/autotest_common.sh@643 -- # es=234 00:05:36.936 07:03:39 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:36.936 07:03:39 -- common/autotest_common.sh@652 -- # es=106 00:05:36.936 07:03:39 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:36.936 07:03:39 -- common/autotest_common.sh@660 -- # es=1 00:05:36.936 07:03:39 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:36.936 00:05:36.936 real 0m0.459s 00:05:36.936 user 0m0.348s 00:05:36.936 sys 0m0.145s 00:05:36.936 07:03:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.936 07:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:36.936 ************************************ 00:05:36.936 END TEST accel_missing_filename 00:05:36.936 ************************************ 00:05:36.936 07:03:39 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.936 07:03:39 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:36.936 07:03:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.936 07:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:36.936 ************************************ 00:05:36.936 START TEST accel_compress_verify 00:05:36.936 ************************************ 00:05:36.936 07:03:39 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.936 07:03:39 -- common/autotest_common.sh@640 -- # local es=0 00:05:37.194 07:03:39 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.194 07:03:39 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:37.194 07:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.194 07:03:39 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:37.194 07:03:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.194 07:03:39 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.194 07:03:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:37.194 07:03:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.194 07:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.194 07:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.194 07:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.194 07:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.194 07:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.194 07:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.194 07:03:39 -- accel/accel.sh@42 -- # jq -r . 00:05:37.194 [2024-10-16 07:03:39.899413] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:37.194 [2024-10-16 07:03:39.899502] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790073 ] 00:05:37.194 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.194 [2024-10-16 07:03:39.962527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.194 [2024-10-16 07:03:40.080827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.453 [2024-10-16 07:03:40.138673] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:37.453 [2024-10-16 07:03:40.220256] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:37.453 00:05:37.453 Compression does not support the verify option, aborting. 00:05:37.453 07:03:40 -- common/autotest_common.sh@643 -- # es=161 00:05:37.453 07:03:40 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:37.453 07:03:40 -- common/autotest_common.sh@652 -- # es=33 00:05:37.453 07:03:40 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:37.453 07:03:40 -- common/autotest_common.sh@660 -- # es=1 00:05:37.453 07:03:40 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:37.453 00:05:37.453 real 0m0.466s 00:05:37.453 user 0m0.365s 00:05:37.453 sys 0m0.136s 00:05:37.453 07:03:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.453 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.453 ************************************ 00:05:37.453 END TEST accel_compress_verify 00:05:37.453 ************************************ 00:05:37.453 07:03:40 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:37.453 07:03:40 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:37.453 07:03:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.453 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.453 ************************************ 00:05:37.453 START TEST accel_wrong_workload 00:05:37.453 ************************************ 00:05:37.453 07:03:40 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:05:37.453 07:03:40 -- common/autotest_common.sh@640 -- # local es=0 00:05:37.453 07:03:40 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:37.453 07:03:40 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:37.453 07:03:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.453 07:03:40 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:37.453 07:03:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.453 07:03:40 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:05:37.453 07:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:37.453 07:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.453 07:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.453 07:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.453 07:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.453 07:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.453 07:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.453 07:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.453 07:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:37.453 Unsupported workload type: foobar 00:05:37.453 [2024-10-16 07:03:40.386344] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:37.453 accel_perf options: 00:05:37.453 [-h help message] 00:05:37.453 [-q queue depth per core] 00:05:37.453 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:37.453 [-T number of threads per core 00:05:37.453 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:37.453 [-t time in seconds] 00:05:37.453 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:37.453 [ dif_verify, , dif_generate, dif_generate_copy 00:05:37.453 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:37.453 [-l for compress/decompress workloads, name of uncompressed input file 00:05:37.453 [-S for crc32c workload, use this seed value (default 0) 00:05:37.453 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:37.453 [-f for fill workload, use this BYTE value (default 255) 00:05:37.453 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:37.453 [-y verify result if this switch is on] 00:05:37.453 [-a tasks to allocate per core (default: same value as -q)] 00:05:37.453 Can be used to spread operations across a wider range of memory. 00:05:37.453 07:03:40 -- common/autotest_common.sh@643 -- # es=1 00:05:37.453 07:03:40 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:37.453 07:03:40 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:37.453 07:03:40 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:37.453 00:05:37.453 real 0m0.023s 00:05:37.453 user 0m0.015s 00:05:37.453 sys 0m0.008s 00:05:37.453 07:03:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.453 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.453 ************************************ 00:05:37.453 END TEST accel_wrong_workload 00:05:37.453 ************************************ 00:05:37.712 Error: writing output failed: Broken pipe 00:05:37.712 07:03:40 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:37.712 07:03:40 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:37.712 07:03:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.712 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.712 ************************************ 00:05:37.712 START TEST accel_negative_buffers 00:05:37.712 ************************************ 00:05:37.712 07:03:40 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:37.712 07:03:40 -- common/autotest_common.sh@640 -- # local es=0 00:05:37.712 07:03:40 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:37.712 07:03:40 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:37.712 07:03:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.712 07:03:40 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:37.712 07:03:40 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:37.712 07:03:40 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:05:37.712 07:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:37.712 07:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.712 07:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.712 07:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.712 07:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.712 07:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:37.712 -x option must be non-negative. 00:05:37.712 [2024-10-16 07:03:40.439221] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:37.712 accel_perf options: 00:05:37.712 [-h help message] 00:05:37.712 [-q queue depth per core] 00:05:37.712 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:37.712 [-T number of threads per core 00:05:37.712 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:37.712 [-t time in seconds] 00:05:37.712 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:37.712 [ dif_verify, , dif_generate, dif_generate_copy 00:05:37.712 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:37.712 [-l for compress/decompress workloads, name of uncompressed input file 00:05:37.712 [-S for crc32c workload, use this seed value (default 0) 00:05:37.712 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:37.712 [-f for fill workload, use this BYTE value (default 255) 00:05:37.712 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:37.712 [-y verify result if this switch is on] 00:05:37.712 [-a tasks to allocate per core (default: same value as -q)] 00:05:37.712 Can be used to spread operations across a wider range of memory. 00:05:37.712 07:03:40 -- common/autotest_common.sh@643 -- # es=1 00:05:37.712 07:03:40 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:37.712 07:03:40 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:37.712 07:03:40 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:37.712 00:05:37.712 real 0m0.025s 00:05:37.712 user 0m0.014s 00:05:37.712 sys 0m0.011s 00:05:37.712 07:03:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.712 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.712 ************************************ 00:05:37.712 END TEST accel_negative_buffers 00:05:37.712 ************************************ 00:05:37.712 Error: writing output failed: Broken pipe 00:05:37.712 07:03:40 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:37.712 07:03:40 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:37.712 07:03:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.712 07:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:37.712 ************************************ 00:05:37.712 START TEST accel_crc32c 00:05:37.712 ************************************ 00:05:37.712 07:03:40 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:37.712 07:03:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.712 07:03:40 -- accel/accel.sh@17 -- # local accel_module 00:05:37.712 07:03:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:37.712 07:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:37.712 07:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.712 07:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.712 07:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.712 07:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.712 07:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.712 07:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:37.712 [2024-10-16 07:03:40.480835] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:37.712 [2024-10-16 07:03:40.480892] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790136 ] 00:05:37.712 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.712 [2024-10-16 07:03:40.542438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.971 [2024-10-16 07:03:40.660524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.345 07:03:41 -- accel/accel.sh@18 -- # out=' 00:05:39.345 SPDK Configuration: 00:05:39.345 Core mask: 0x1 00:05:39.345 00:05:39.345 Accel Perf Configuration: 00:05:39.345 Workload Type: crc32c 00:05:39.345 CRC-32C seed: 32 00:05:39.345 Transfer size: 4096 bytes 00:05:39.345 Vector count 1 00:05:39.345 Module: software 00:05:39.345 Queue depth: 32 00:05:39.345 Allocate depth: 32 00:05:39.345 # threads/core: 1 00:05:39.345 Run time: 1 seconds 00:05:39.345 Verify: Yes 00:05:39.345 00:05:39.345 Running for 1 seconds... 00:05:39.345 00:05:39.345 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.345 ------------------------------------------------------------------------------------ 00:05:39.345 0,0 406688/s 1588 MiB/s 0 0 00:05:39.345 ==================================================================================== 00:05:39.345 Total 406688/s 1588 MiB/s 0 0' 00:05:39.345 07:03:41 -- accel/accel.sh@20 -- # IFS=: 00:05:39.345 07:03:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:39.345 07:03:41 -- accel/accel.sh@20 -- # read -r var val 00:05:39.345 07:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:39.345 07:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.345 07:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.345 07:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.345 07:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.345 07:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.345 07:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.345 07:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.345 07:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:39.345 [2024-10-16 07:03:41.953656] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:39.345 [2024-10-16 07:03:41.953742] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790291 ] 00:05:39.346 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.346 [2024-10-16 07:03:42.016773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.346 [2024-10-16 07:03:42.133878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=0x1 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=crc32c 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=32 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=software 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=32 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=32 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=1 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val=Yes 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:39.346 07:03:42 -- accel/accel.sh@21 -- # val= 00:05:39.346 07:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:39.346 07:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@21 -- # val= 00:05:40.720 07:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:40.720 07:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:40.720 07:03:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.720 07:03:43 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:40.720 07:03:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.720 00:05:40.720 real 0m2.943s 00:05:40.720 user 0m2.645s 00:05:40.720 sys 0m0.290s 00:05:40.720 07:03:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:40.720 07:03:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.720 ************************************ 00:05:40.720 END TEST accel_crc32c 00:05:40.720 ************************************ 00:05:40.720 07:03:43 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:40.720 07:03:43 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:40.720 07:03:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:40.720 07:03:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.720 ************************************ 00:05:40.720 START TEST accel_crc32c_C2 00:05:40.720 ************************************ 00:05:40.720 07:03:43 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:40.720 07:03:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.720 07:03:43 -- accel/accel.sh@17 -- # local accel_module 00:05:40.720 07:03:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:40.720 07:03:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:40.720 07:03:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.720 07:03:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.720 07:03:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.720 07:03:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.720 07:03:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.720 07:03:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.720 07:03:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.720 07:03:43 -- accel/accel.sh@42 -- # jq -r . 00:05:40.720 [2024-10-16 07:03:43.451317] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:40.720 [2024-10-16 07:03:43.451391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790558 ] 00:05:40.720 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.720 [2024-10-16 07:03:43.511101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.720 [2024-10-16 07:03:43.626708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.128 07:03:44 -- accel/accel.sh@18 -- # out=' 00:05:42.128 SPDK Configuration: 00:05:42.128 Core mask: 0x1 00:05:42.128 00:05:42.128 Accel Perf Configuration: 00:05:42.128 Workload Type: crc32c 00:05:42.128 CRC-32C seed: 0 00:05:42.128 Transfer size: 4096 bytes 00:05:42.128 Vector count 2 00:05:42.128 Module: software 00:05:42.128 Queue depth: 32 00:05:42.128 Allocate depth: 32 00:05:42.128 # threads/core: 1 00:05:42.128 Run time: 1 seconds 00:05:42.128 Verify: Yes 00:05:42.128 00:05:42.128 Running for 1 seconds... 00:05:42.128 00:05:42.128 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.128 ------------------------------------------------------------------------------------ 00:05:42.128 0,0 315136/s 2462 MiB/s 0 0 00:05:42.128 ==================================================================================== 00:05:42.128 Total 315136/s 1231 MiB/s 0 0' 00:05:42.128 07:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:42.128 07:03:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:42.129 07:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:42.129 07:03:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:42.129 07:03:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.129 07:03:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.129 07:03:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.129 07:03:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.129 07:03:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.129 07:03:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.129 07:03:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.129 07:03:44 -- accel/accel.sh@42 -- # jq -r . 00:05:42.129 [2024-10-16 07:03:44.915064] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:42.129 [2024-10-16 07:03:44.915162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790709 ] 00:05:42.129 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.129 [2024-10-16 07:03:44.975724] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.386 [2024-10-16 07:03:45.093196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=0x1 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=crc32c 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=0 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=software 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=32 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=32 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=1 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val=Yes 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:42.386 07:03:45 -- accel/accel.sh@21 -- # val= 00:05:42.386 07:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:42.386 07:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@21 -- # val= 00:05:43.762 07:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:43.762 07:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:43.762 07:03:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.762 07:03:46 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:43.762 07:03:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.762 00:05:43.762 real 0m2.946s 00:05:43.762 user 0m2.660s 00:05:43.762 sys 0m0.277s 00:05:43.762 07:03:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:43.762 07:03:46 -- common/autotest_common.sh@10 -- # set +x 00:05:43.762 ************************************ 00:05:43.762 END TEST accel_crc32c_C2 00:05:43.762 ************************************ 00:05:43.762 07:03:46 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:43.762 07:03:46 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:43.762 07:03:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:43.762 07:03:46 -- common/autotest_common.sh@10 -- # set +x 00:05:43.762 ************************************ 00:05:43.762 START TEST accel_copy 00:05:43.762 ************************************ 00:05:43.762 07:03:46 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:05:43.762 07:03:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.762 07:03:46 -- accel/accel.sh@17 -- # local accel_module 00:05:43.762 07:03:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:43.762 07:03:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:43.762 07:03:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.762 07:03:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.762 07:03:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.762 07:03:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.762 07:03:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.762 07:03:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.762 07:03:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.762 07:03:46 -- accel/accel.sh@42 -- # jq -r . 00:05:43.762 [2024-10-16 07:03:46.424939] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:43.762 [2024-10-16 07:03:46.425039] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1790864 ] 00:05:43.762 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.762 [2024-10-16 07:03:46.488057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.762 [2024-10-16 07:03:46.606501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.134 07:03:47 -- accel/accel.sh@18 -- # out=' 00:05:45.134 SPDK Configuration: 00:05:45.134 Core mask: 0x1 00:05:45.134 00:05:45.134 Accel Perf Configuration: 00:05:45.134 Workload Type: copy 00:05:45.134 Transfer size: 4096 bytes 00:05:45.134 Vector count 1 00:05:45.134 Module: software 00:05:45.134 Queue depth: 32 00:05:45.134 Allocate depth: 32 00:05:45.134 # threads/core: 1 00:05:45.135 Run time: 1 seconds 00:05:45.135 Verify: Yes 00:05:45.135 00:05:45.135 Running for 1 seconds... 00:05:45.135 00:05:45.135 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.135 ------------------------------------------------------------------------------------ 00:05:45.135 0,0 276672/s 1080 MiB/s 0 0 00:05:45.135 ==================================================================================== 00:05:45.135 Total 276672/s 1080 MiB/s 0 0' 00:05:45.135 07:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:45.135 07:03:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:45.135 07:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:45.135 07:03:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:45.135 07:03:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.135 07:03:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.135 07:03:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.135 07:03:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.135 07:03:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.135 07:03:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.135 07:03:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.135 07:03:47 -- accel/accel.sh@42 -- # jq -r . 00:05:45.135 [2024-10-16 07:03:47.901356] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:45.135 [2024-10-16 07:03:47.901439] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1791127 ] 00:05:45.135 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.135 [2024-10-16 07:03:47.966363] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.393 [2024-10-16 07:03:48.084316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=0x1 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=copy 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=software 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=32 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=32 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=1 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val=Yes 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:45.393 07:03:48 -- accel/accel.sh@21 -- # val= 00:05:45.393 07:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:45.393 07:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@21 -- # val= 00:05:46.766 07:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:46.766 07:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:46.766 07:03:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.766 07:03:49 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:46.766 07:03:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.766 00:05:46.766 real 0m2.954s 00:05:46.766 user 0m2.652s 00:05:46.766 sys 0m0.290s 00:05:46.766 07:03:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:46.766 07:03:49 -- common/autotest_common.sh@10 -- # set +x 00:05:46.766 ************************************ 00:05:46.766 END TEST accel_copy 00:05:46.766 ************************************ 00:05:46.766 07:03:49 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.766 07:03:49 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:46.766 07:03:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:46.766 07:03:49 -- common/autotest_common.sh@10 -- # set +x 00:05:46.766 ************************************ 00:05:46.766 START TEST accel_fill 00:05:46.766 ************************************ 00:05:46.766 07:03:49 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.766 07:03:49 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.766 07:03:49 -- accel/accel.sh@17 -- # local accel_module 00:05:46.766 07:03:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.766 07:03:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.766 07:03:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.766 07:03:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.766 07:03:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.766 07:03:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.766 07:03:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.766 07:03:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.766 07:03:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.766 07:03:49 -- accel/accel.sh@42 -- # jq -r . 00:05:46.766 [2024-10-16 07:03:49.400629] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:46.766 [2024-10-16 07:03:49.400713] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1791291 ] 00:05:46.766 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.766 [2024-10-16 07:03:49.467210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.766 [2024-10-16 07:03:49.588052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.141 07:03:50 -- accel/accel.sh@18 -- # out=' 00:05:48.141 SPDK Configuration: 00:05:48.141 Core mask: 0x1 00:05:48.141 00:05:48.141 Accel Perf Configuration: 00:05:48.141 Workload Type: fill 00:05:48.141 Fill pattern: 0x80 00:05:48.141 Transfer size: 4096 bytes 00:05:48.141 Vector count 1 00:05:48.141 Module: software 00:05:48.141 Queue depth: 64 00:05:48.141 Allocate depth: 64 00:05:48.141 # threads/core: 1 00:05:48.141 Run time: 1 seconds 00:05:48.141 Verify: Yes 00:05:48.141 00:05:48.141 Running for 1 seconds... 00:05:48.141 00:05:48.141 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.141 ------------------------------------------------------------------------------------ 00:05:48.141 0,0 404800/s 1581 MiB/s 0 0 00:05:48.141 ==================================================================================== 00:05:48.141 Total 404800/s 1581 MiB/s 0 0' 00:05:48.141 07:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:48.141 07:03:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.141 07:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:48.141 07:03:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:48.141 07:03:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.141 07:03:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.141 07:03:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.141 07:03:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.141 07:03:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.141 07:03:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.141 07:03:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.141 07:03:50 -- accel/accel.sh@42 -- # jq -r . 00:05:48.141 [2024-10-16 07:03:50.890908] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:48.141 [2024-10-16 07:03:50.890992] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1791430 ] 00:05:48.141 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.141 [2024-10-16 07:03:50.951957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.141 [2024-10-16 07:03:51.075500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=0x1 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=fill 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=0x80 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=software 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=64 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=64 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=1 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.399 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.399 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.399 07:03:51 -- accel/accel.sh@21 -- # val=Yes 00:05:48.400 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.400 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.400 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:48.400 07:03:51 -- accel/accel.sh@21 -- # val= 00:05:48.400 07:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:48.400 07:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@21 -- # val= 00:05:49.773 07:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:49.773 07:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:49.773 07:03:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.773 07:03:52 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:49.773 07:03:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.773 00:05:49.773 real 0m2.970s 00:05:49.773 user 0m2.659s 00:05:49.773 sys 0m0.301s 00:05:49.773 07:03:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:49.773 07:03:52 -- common/autotest_common.sh@10 -- # set +x 00:05:49.773 ************************************ 00:05:49.773 END TEST accel_fill 00:05:49.773 ************************************ 00:05:49.773 07:03:52 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:49.773 07:03:52 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:49.773 07:03:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:49.773 07:03:52 -- common/autotest_common.sh@10 -- # set +x 00:05:49.773 ************************************ 00:05:49.773 START TEST accel_copy_crc32c 00:05:49.773 ************************************ 00:05:49.773 07:03:52 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:49.773 07:03:52 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.773 07:03:52 -- accel/accel.sh@17 -- # local accel_module 00:05:49.773 07:03:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:49.773 07:03:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:49.773 07:03:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.773 07:03:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.773 07:03:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.773 07:03:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.773 07:03:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.773 07:03:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.773 07:03:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.773 07:03:52 -- accel/accel.sh@42 -- # jq -r . 00:05:49.773 [2024-10-16 07:03:52.400874] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:49.773 [2024-10-16 07:03:52.400970] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1791710 ] 00:05:49.773 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.773 [2024-10-16 07:03:52.464663] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.773 [2024-10-16 07:03:52.579741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.147 07:03:53 -- accel/accel.sh@18 -- # out=' 00:05:51.147 SPDK Configuration: 00:05:51.147 Core mask: 0x1 00:05:51.147 00:05:51.147 Accel Perf Configuration: 00:05:51.147 Workload Type: copy_crc32c 00:05:51.147 CRC-32C seed: 0 00:05:51.147 Vector size: 4096 bytes 00:05:51.147 Transfer size: 4096 bytes 00:05:51.147 Vector count 1 00:05:51.147 Module: software 00:05:51.147 Queue depth: 32 00:05:51.147 Allocate depth: 32 00:05:51.147 # threads/core: 1 00:05:51.147 Run time: 1 seconds 00:05:51.147 Verify: Yes 00:05:51.147 00:05:51.147 Running for 1 seconds... 00:05:51.147 00:05:51.147 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.147 ------------------------------------------------------------------------------------ 00:05:51.147 0,0 218592/s 853 MiB/s 0 0 00:05:51.147 ==================================================================================== 00:05:51.147 Total 218592/s 853 MiB/s 0 0' 00:05:51.147 07:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:51.147 07:03:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:51.147 07:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:51.147 07:03:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:51.147 07:03:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.147 07:03:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.147 07:03:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.147 07:03:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.147 07:03:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.147 07:03:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.147 07:03:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.147 07:03:53 -- accel/accel.sh@42 -- # jq -r . 00:05:51.147 [2024-10-16 07:03:53.873276] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:51.147 [2024-10-16 07:03:53.873358] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1791853 ] 00:05:51.147 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.147 [2024-10-16 07:03:53.938537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.147 [2024-10-16 07:03:54.060771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=0x1 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=0 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=software 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=32 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=32 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=1 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val=Yes 00:05:51.405 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.405 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.405 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.406 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.406 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.406 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:51.406 07:03:54 -- accel/accel.sh@21 -- # val= 00:05:51.406 07:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.406 07:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:51.406 07:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@21 -- # val= 00:05:52.826 07:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:52.826 07:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:52.826 07:03:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.826 07:03:55 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:52.826 07:03:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.826 00:05:52.826 real 0m2.967s 00:05:52.826 user 0m2.675s 00:05:52.826 sys 0m0.283s 00:05:52.826 07:03:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.826 07:03:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.826 ************************************ 00:05:52.826 END TEST accel_copy_crc32c 00:05:52.826 ************************************ 00:05:52.826 07:03:55 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:52.826 07:03:55 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:52.826 07:03:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.826 07:03:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.826 ************************************ 00:05:52.826 START TEST accel_copy_crc32c_C2 00:05:52.826 ************************************ 00:05:52.826 07:03:55 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:52.826 07:03:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.826 07:03:55 -- accel/accel.sh@17 -- # local accel_module 00:05:52.826 07:03:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:52.826 07:03:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:52.826 07:03:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.826 07:03:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.826 07:03:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.826 07:03:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.826 07:03:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.826 07:03:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.826 07:03:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.826 07:03:55 -- accel/accel.sh@42 -- # jq -r . 00:05:52.826 [2024-10-16 07:03:55.396042] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:52.826 [2024-10-16 07:03:55.396137] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1792019 ] 00:05:52.826 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.826 [2024-10-16 07:03:55.458969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.826 [2024-10-16 07:03:55.577099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.225 07:03:56 -- accel/accel.sh@18 -- # out=' 00:05:54.225 SPDK Configuration: 00:05:54.225 Core mask: 0x1 00:05:54.225 00:05:54.225 Accel Perf Configuration: 00:05:54.225 Workload Type: copy_crc32c 00:05:54.225 CRC-32C seed: 0 00:05:54.225 Vector size: 4096 bytes 00:05:54.225 Transfer size: 8192 bytes 00:05:54.225 Vector count 2 00:05:54.225 Module: software 00:05:54.225 Queue depth: 32 00:05:54.225 Allocate depth: 32 00:05:54.225 # threads/core: 1 00:05:54.225 Run time: 1 seconds 00:05:54.225 Verify: Yes 00:05:54.225 00:05:54.225 Running for 1 seconds... 00:05:54.225 00:05:54.225 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.225 ------------------------------------------------------------------------------------ 00:05:54.225 0,0 154656/s 1208 MiB/s 0 0 00:05:54.225 ==================================================================================== 00:05:54.225 Total 154656/s 604 MiB/s 0 0' 00:05:54.225 07:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:54.225 07:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:54.225 07:03:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.225 07:03:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.225 07:03:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.225 07:03:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.225 07:03:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.225 07:03:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.225 07:03:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.225 07:03:56 -- accel/accel.sh@42 -- # jq -r . 00:05:54.225 [2024-10-16 07:03:56.874842] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:54.225 [2024-10-16 07:03:56.874929] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1792260 ] 00:05:54.225 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.225 [2024-10-16 07:03:56.941966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.225 [2024-10-16 07:03:57.062991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=0x1 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=0 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=software 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=32 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=32 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val=1 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.225 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.225 07:03:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.225 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.226 07:03:57 -- accel/accel.sh@21 -- # val=Yes 00:05:54.226 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.226 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.226 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:54.226 07:03:57 -- accel/accel.sh@21 -- # val= 00:05:54.226 07:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:54.226 07:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@21 -- # val= 00:05:55.598 07:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:55.598 07:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:55.598 07:03:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.598 07:03:58 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:55.598 07:03:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.598 00:05:55.598 real 0m2.953s 00:05:55.598 user 0m2.645s 00:05:55.598 sys 0m0.299s 00:05:55.598 07:03:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.598 07:03:58 -- common/autotest_common.sh@10 -- # set +x 00:05:55.598 ************************************ 00:05:55.598 END TEST accel_copy_crc32c_C2 00:05:55.598 ************************************ 00:05:55.598 07:03:58 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:55.598 07:03:58 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:55.598 07:03:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.598 07:03:58 -- common/autotest_common.sh@10 -- # set +x 00:05:55.598 ************************************ 00:05:55.598 START TEST accel_dualcast 00:05:55.598 ************************************ 00:05:55.598 07:03:58 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:55.598 07:03:58 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.598 07:03:58 -- accel/accel.sh@17 -- # local accel_module 00:05:55.598 07:03:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:55.598 07:03:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:55.598 07:03:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.598 07:03:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.598 07:03:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.598 07:03:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.598 07:03:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.598 07:03:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.598 07:03:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.598 07:03:58 -- accel/accel.sh@42 -- # jq -r . 00:05:55.598 [2024-10-16 07:03:58.372288] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:55.598 [2024-10-16 07:03:58.372369] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1792446 ] 00:05:55.598 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.598 [2024-10-16 07:03:58.434090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.856 [2024-10-16 07:03:58.553562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.231 07:03:59 -- accel/accel.sh@18 -- # out=' 00:05:57.231 SPDK Configuration: 00:05:57.231 Core mask: 0x1 00:05:57.231 00:05:57.231 Accel Perf Configuration: 00:05:57.231 Workload Type: dualcast 00:05:57.231 Transfer size: 4096 bytes 00:05:57.231 Vector count 1 00:05:57.231 Module: software 00:05:57.231 Queue depth: 32 00:05:57.231 Allocate depth: 32 00:05:57.231 # threads/core: 1 00:05:57.231 Run time: 1 seconds 00:05:57.231 Verify: Yes 00:05:57.231 00:05:57.231 Running for 1 seconds... 00:05:57.231 00:05:57.231 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.231 ------------------------------------------------------------------------------------ 00:05:57.231 0,0 295680/s 1155 MiB/s 0 0 00:05:57.231 ==================================================================================== 00:05:57.231 Total 295680/s 1155 MiB/s 0 0' 00:05:57.231 07:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:57.231 07:03:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:57.231 07:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:57.231 07:03:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:57.231 07:03:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.231 07:03:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.231 07:03:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.231 07:03:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.231 07:03:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.231 07:03:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.231 07:03:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.231 07:03:59 -- accel/accel.sh@42 -- # jq -r . 00:05:57.231 [2024-10-16 07:03:59.849742] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:57.231 [2024-10-16 07:03:59.849827] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1792589 ] 00:05:57.231 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.231 [2024-10-16 07:03:59.910793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.231 [2024-10-16 07:04:00.034378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.231 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.231 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.231 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.231 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.231 07:04:00 -- accel/accel.sh@21 -- # val=0x1 00:05:57.231 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.231 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=dualcast 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=software 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=32 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=32 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=1 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val=Yes 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:57.232 07:04:00 -- accel/accel.sh@21 -- # val= 00:05:57.232 07:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:57.232 07:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@21 -- # val= 00:05:58.605 07:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:58.605 07:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:58.605 07:04:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.605 07:04:01 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:58.605 07:04:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.605 00:05:58.605 real 0m2.966s 00:05:58.605 user 0m2.659s 00:05:58.605 sys 0m0.296s 00:05:58.605 07:04:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:58.605 07:04:01 -- common/autotest_common.sh@10 -- # set +x 00:05:58.605 ************************************ 00:05:58.605 END TEST accel_dualcast 00:05:58.605 ************************************ 00:05:58.605 07:04:01 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:58.605 07:04:01 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:58.605 07:04:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:58.605 07:04:01 -- common/autotest_common.sh@10 -- # set +x 00:05:58.605 ************************************ 00:05:58.605 START TEST accel_compare 00:05:58.605 ************************************ 00:05:58.605 07:04:01 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:58.605 07:04:01 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.605 07:04:01 -- accel/accel.sh@17 -- # local accel_module 00:05:58.605 07:04:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:58.605 07:04:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:58.605 07:04:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.605 07:04:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.605 07:04:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.605 07:04:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.605 07:04:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.605 07:04:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.605 07:04:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.605 07:04:01 -- accel/accel.sh@42 -- # jq -r . 00:05:58.605 [2024-10-16 07:04:01.362815] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:58.605 [2024-10-16 07:04:01.362897] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1792782 ] 00:05:58.605 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.605 [2024-10-16 07:04:01.424158] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.605 [2024-10-16 07:04:01.544262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.978 07:04:02 -- accel/accel.sh@18 -- # out=' 00:05:59.978 SPDK Configuration: 00:05:59.978 Core mask: 0x1 00:05:59.978 00:05:59.978 Accel Perf Configuration: 00:05:59.978 Workload Type: compare 00:05:59.978 Transfer size: 4096 bytes 00:05:59.978 Vector count 1 00:05:59.978 Module: software 00:05:59.978 Queue depth: 32 00:05:59.978 Allocate depth: 32 00:05:59.978 # threads/core: 1 00:05:59.978 Run time: 1 seconds 00:05:59.978 Verify: Yes 00:05:59.978 00:05:59.978 Running for 1 seconds... 00:05:59.978 00:05:59.978 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.978 ------------------------------------------------------------------------------------ 00:05:59.978 0,0 398752/s 1557 MiB/s 0 0 00:05:59.978 ==================================================================================== 00:05:59.978 Total 398752/s 1557 MiB/s 0 0' 00:05:59.978 07:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:59.979 07:04:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:59.979 07:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:59.979 07:04:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:59.979 07:04:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.979 07:04:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.979 07:04:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.979 07:04:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.979 07:04:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.979 07:04:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.979 07:04:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.979 07:04:02 -- accel/accel.sh@42 -- # jq -r . 00:05:59.979 [2024-10-16 07:04:02.830886] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:59.979 [2024-10-16 07:04:02.830971] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793011 ] 00:05:59.979 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.979 [2024-10-16 07:04:02.894922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.237 [2024-10-16 07:04:03.016037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=0x1 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=compare 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=software 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=32 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=32 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=1 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val=Yes 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:00.237 07:04:03 -- accel/accel.sh@21 -- # val= 00:06:00.237 07:04:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # IFS=: 00:06:00.237 07:04:03 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@21 -- # val= 00:06:01.611 07:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # IFS=: 00:06:01.611 07:04:04 -- accel/accel.sh@20 -- # read -r var val 00:06:01.611 07:04:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.611 07:04:04 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:01.611 07:04:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.611 00:06:01.611 real 0m2.953s 00:06:01.611 user 0m2.658s 00:06:01.611 sys 0m0.285s 00:06:01.611 07:04:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:01.611 07:04:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.611 ************************************ 00:06:01.611 END TEST accel_compare 00:06:01.611 ************************************ 00:06:01.611 07:04:04 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:01.611 07:04:04 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:01.611 07:04:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:01.611 07:04:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.611 ************************************ 00:06:01.611 START TEST accel_xor 00:06:01.611 ************************************ 00:06:01.611 07:04:04 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:06:01.611 07:04:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.611 07:04:04 -- accel/accel.sh@17 -- # local accel_module 00:06:01.611 07:04:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:01.611 07:04:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:01.611 07:04:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.611 07:04:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.611 07:04:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.611 07:04:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.611 07:04:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.611 07:04:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.611 07:04:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.611 07:04:04 -- accel/accel.sh@42 -- # jq -r . 00:06:01.611 [2024-10-16 07:04:04.341958] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:01.611 [2024-10-16 07:04:04.342041] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793177 ] 00:06:01.611 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.611 [2024-10-16 07:04:04.404972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.611 [2024-10-16 07:04:04.525700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.985 07:04:05 -- accel/accel.sh@18 -- # out=' 00:06:02.985 SPDK Configuration: 00:06:02.985 Core mask: 0x1 00:06:02.985 00:06:02.985 Accel Perf Configuration: 00:06:02.985 Workload Type: xor 00:06:02.985 Source buffers: 2 00:06:02.985 Transfer size: 4096 bytes 00:06:02.985 Vector count 1 00:06:02.985 Module: software 00:06:02.985 Queue depth: 32 00:06:02.985 Allocate depth: 32 00:06:02.985 # threads/core: 1 00:06:02.985 Run time: 1 seconds 00:06:02.985 Verify: Yes 00:06:02.985 00:06:02.985 Running for 1 seconds... 00:06:02.985 00:06:02.985 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.985 ------------------------------------------------------------------------------------ 00:06:02.985 0,0 193152/s 754 MiB/s 0 0 00:06:02.985 ==================================================================================== 00:06:02.985 Total 193152/s 754 MiB/s 0 0' 00:06:02.985 07:04:05 -- accel/accel.sh@20 -- # IFS=: 00:06:02.985 07:04:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:02.985 07:04:05 -- accel/accel.sh@20 -- # read -r var val 00:06:02.985 07:04:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:02.985 07:04:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.985 07:04:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.985 07:04:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.985 07:04:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.985 07:04:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.985 07:04:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.985 07:04:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.985 07:04:05 -- accel/accel.sh@42 -- # jq -r . 00:06:02.985 [2024-10-16 07:04:05.828524] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:02.985 [2024-10-16 07:04:05.828610] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793316 ] 00:06:02.985 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.985 [2024-10-16 07:04:05.894791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.244 [2024-10-16 07:04:06.015492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=0x1 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=xor 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=2 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=software 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=32 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=32 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=1 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val=Yes 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.244 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:03.244 07:04:06 -- accel/accel.sh@21 -- # val= 00:06:03.244 07:04:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.245 07:04:06 -- accel/accel.sh@20 -- # IFS=: 00:06:03.245 07:04:06 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@21 -- # val= 00:06:04.618 07:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # IFS=: 00:06:04.618 07:04:07 -- accel/accel.sh@20 -- # read -r var val 00:06:04.618 07:04:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.618 07:04:07 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:04.618 07:04:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.618 00:06:04.618 real 0m2.976s 00:06:04.618 user 0m2.670s 00:06:04.618 sys 0m0.296s 00:06:04.618 07:04:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:04.618 07:04:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.618 ************************************ 00:06:04.618 END TEST accel_xor 00:06:04.618 ************************************ 00:06:04.618 07:04:07 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:04.618 07:04:07 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:04.618 07:04:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:04.618 07:04:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.618 ************************************ 00:06:04.618 START TEST accel_xor 00:06:04.618 ************************************ 00:06:04.618 07:04:07 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:06:04.618 07:04:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.618 07:04:07 -- accel/accel.sh@17 -- # local accel_module 00:06:04.618 07:04:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:04.619 07:04:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:04.619 07:04:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.619 07:04:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.619 07:04:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.619 07:04:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.619 07:04:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.619 07:04:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.619 07:04:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.619 07:04:07 -- accel/accel.sh@42 -- # jq -r . 00:06:04.619 [2024-10-16 07:04:07.341668] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:04.619 [2024-10-16 07:04:07.341763] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793596 ] 00:06:04.619 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.619 [2024-10-16 07:04:07.404309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.619 [2024-10-16 07:04:07.521923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.992 07:04:08 -- accel/accel.sh@18 -- # out=' 00:06:05.992 SPDK Configuration: 00:06:05.992 Core mask: 0x1 00:06:05.992 00:06:05.992 Accel Perf Configuration: 00:06:05.993 Workload Type: xor 00:06:05.993 Source buffers: 3 00:06:05.993 Transfer size: 4096 bytes 00:06:05.993 Vector count 1 00:06:05.993 Module: software 00:06:05.993 Queue depth: 32 00:06:05.993 Allocate depth: 32 00:06:05.993 # threads/core: 1 00:06:05.993 Run time: 1 seconds 00:06:05.993 Verify: Yes 00:06:05.993 00:06:05.993 Running for 1 seconds... 00:06:05.993 00:06:05.993 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.993 ------------------------------------------------------------------------------------ 00:06:05.993 0,0 182400/s 712 MiB/s 0 0 00:06:05.993 ==================================================================================== 00:06:05.993 Total 182400/s 712 MiB/s 0 0' 00:06:05.993 07:04:08 -- accel/accel.sh@20 -- # IFS=: 00:06:05.993 07:04:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:05.993 07:04:08 -- accel/accel.sh@20 -- # read -r var val 00:06:05.993 07:04:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:05.993 07:04:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.993 07:04:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.993 07:04:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.993 07:04:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.993 07:04:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.993 07:04:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.993 07:04:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.993 07:04:08 -- accel/accel.sh@42 -- # jq -r . 00:06:05.993 [2024-10-16 07:04:08.814544] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:05.993 [2024-10-16 07:04:08.814626] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793741 ] 00:06:05.993 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.993 [2024-10-16 07:04:08.877096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.251 [2024-10-16 07:04:08.996129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=0x1 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=xor 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=3 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=software 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=32 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=32 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=1 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val=Yes 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:06.251 07:04:09 -- accel/accel.sh@21 -- # val= 00:06:06.251 07:04:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # IFS=: 00:06:06.251 07:04:09 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@21 -- # val= 00:06:07.624 07:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # IFS=: 00:06:07.624 07:04:10 -- accel/accel.sh@20 -- # read -r var val 00:06:07.624 07:04:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.624 07:04:10 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:07.624 07:04:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.624 00:06:07.624 real 0m2.958s 00:06:07.624 user 0m2.663s 00:06:07.624 sys 0m0.286s 00:06:07.624 07:04:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.624 07:04:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.624 ************************************ 00:06:07.624 END TEST accel_xor 00:06:07.624 ************************************ 00:06:07.624 07:04:10 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:07.624 07:04:10 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:07.624 07:04:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.624 07:04:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.624 ************************************ 00:06:07.624 START TEST accel_dif_verify 00:06:07.624 ************************************ 00:06:07.624 07:04:10 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:06:07.624 07:04:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.624 07:04:10 -- accel/accel.sh@17 -- # local accel_module 00:06:07.624 07:04:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:07.624 07:04:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:07.624 07:04:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.624 07:04:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.624 07:04:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.624 07:04:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.624 07:04:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.624 07:04:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.624 07:04:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.624 07:04:10 -- accel/accel.sh@42 -- # jq -r . 00:06:07.624 [2024-10-16 07:04:10.324469] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:07.624 [2024-10-16 07:04:10.324551] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1793905 ] 00:06:07.624 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.624 [2024-10-16 07:04:10.385683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.624 [2024-10-16 07:04:10.511474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.999 07:04:11 -- accel/accel.sh@18 -- # out=' 00:06:08.999 SPDK Configuration: 00:06:08.999 Core mask: 0x1 00:06:08.999 00:06:08.999 Accel Perf Configuration: 00:06:08.999 Workload Type: dif_verify 00:06:08.999 Vector size: 4096 bytes 00:06:08.999 Transfer size: 4096 bytes 00:06:08.999 Block size: 512 bytes 00:06:08.999 Metadata size: 8 bytes 00:06:08.999 Vector count 1 00:06:08.999 Module: software 00:06:08.999 Queue depth: 32 00:06:08.999 Allocate depth: 32 00:06:08.999 # threads/core: 1 00:06:08.999 Run time: 1 seconds 00:06:08.999 Verify: No 00:06:08.999 00:06:08.999 Running for 1 seconds... 00:06:08.999 00:06:08.999 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.999 ------------------------------------------------------------------------------------ 00:06:08.999 0,0 81728/s 324 MiB/s 0 0 00:06:08.999 ==================================================================================== 00:06:08.999 Total 81728/s 319 MiB/s 0 0' 00:06:08.999 07:04:11 -- accel/accel.sh@20 -- # IFS=: 00:06:08.999 07:04:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:08.999 07:04:11 -- accel/accel.sh@20 -- # read -r var val 00:06:08.999 07:04:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:08.999 07:04:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.999 07:04:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.999 07:04:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.999 07:04:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.999 07:04:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.999 07:04:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.999 07:04:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.999 07:04:11 -- accel/accel.sh@42 -- # jq -r . 00:06:08.999 [2024-10-16 07:04:11.809234] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:08.999 [2024-10-16 07:04:11.809317] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1794162 ] 00:06:08.999 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.999 [2024-10-16 07:04:11.870491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.258 [2024-10-16 07:04:11.990834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=0x1 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=dif_verify 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=software 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=32 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=32 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=1 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val=No 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:09.258 07:04:12 -- accel/accel.sh@21 -- # val= 00:06:09.258 07:04:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # IFS=: 00:06:09.258 07:04:12 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@21 -- # val= 00:06:10.633 07:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # IFS=: 00:06:10.633 07:04:13 -- accel/accel.sh@20 -- # read -r var val 00:06:10.633 07:04:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.633 07:04:13 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:10.633 07:04:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.633 00:06:10.633 real 0m2.967s 00:06:10.633 user 0m2.673s 00:06:10.633 sys 0m0.287s 00:06:10.633 07:04:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.633 07:04:13 -- common/autotest_common.sh@10 -- # set +x 00:06:10.633 ************************************ 00:06:10.633 END TEST accel_dif_verify 00:06:10.633 ************************************ 00:06:10.633 07:04:13 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:10.633 07:04:13 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:10.633 07:04:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.633 07:04:13 -- common/autotest_common.sh@10 -- # set +x 00:06:10.633 ************************************ 00:06:10.633 START TEST accel_dif_generate 00:06:10.633 ************************************ 00:06:10.633 07:04:13 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:06:10.633 07:04:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.633 07:04:13 -- accel/accel.sh@17 -- # local accel_module 00:06:10.633 07:04:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:10.633 07:04:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:10.633 07:04:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.633 07:04:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.633 07:04:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.633 07:04:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.633 07:04:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.633 07:04:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.633 07:04:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.633 07:04:13 -- accel/accel.sh@42 -- # jq -r . 00:06:10.633 [2024-10-16 07:04:13.320507] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:10.633 [2024-10-16 07:04:13.320598] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1794327 ] 00:06:10.633 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.633 [2024-10-16 07:04:13.383141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.633 [2024-10-16 07:04:13.502757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.006 07:04:14 -- accel/accel.sh@18 -- # out=' 00:06:12.006 SPDK Configuration: 00:06:12.006 Core mask: 0x1 00:06:12.006 00:06:12.006 Accel Perf Configuration: 00:06:12.006 Workload Type: dif_generate 00:06:12.006 Vector size: 4096 bytes 00:06:12.006 Transfer size: 4096 bytes 00:06:12.006 Block size: 512 bytes 00:06:12.006 Metadata size: 8 bytes 00:06:12.006 Vector count 1 00:06:12.006 Module: software 00:06:12.006 Queue depth: 32 00:06:12.006 Allocate depth: 32 00:06:12.006 # threads/core: 1 00:06:12.006 Run time: 1 seconds 00:06:12.006 Verify: No 00:06:12.006 00:06:12.006 Running for 1 seconds... 00:06:12.006 00:06:12.006 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.006 ------------------------------------------------------------------------------------ 00:06:12.006 0,0 96288/s 382 MiB/s 0 0 00:06:12.006 ==================================================================================== 00:06:12.006 Total 96288/s 376 MiB/s 0 0' 00:06:12.006 07:04:14 -- accel/accel.sh@20 -- # IFS=: 00:06:12.006 07:04:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:12.006 07:04:14 -- accel/accel.sh@20 -- # read -r var val 00:06:12.007 07:04:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:12.007 07:04:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.007 07:04:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.007 07:04:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.007 07:04:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.007 07:04:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.007 07:04:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.007 07:04:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.007 07:04:14 -- accel/accel.sh@42 -- # jq -r . 00:06:12.007 [2024-10-16 07:04:14.798655] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:12.007 [2024-10-16 07:04:14.798749] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1794471 ] 00:06:12.007 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.007 [2024-10-16 07:04:14.864253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.265 [2024-10-16 07:04:14.987274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=0x1 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=dif_generate 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=software 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=32 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=32 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=1 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val=No 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:12.265 07:04:15 -- accel/accel.sh@21 -- # val= 00:06:12.265 07:04:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # IFS=: 00:06:12.265 07:04:15 -- accel/accel.sh@20 -- # read -r var val 00:06:13.640 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.640 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.640 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.640 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.640 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.640 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.640 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.640 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.640 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.641 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.641 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.641 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.641 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.641 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.641 07:04:16 -- accel/accel.sh@21 -- # val= 00:06:13.641 07:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # IFS=: 00:06:13.641 07:04:16 -- accel/accel.sh@20 -- # read -r var val 00:06:13.641 07:04:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.641 07:04:16 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:13.641 07:04:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.641 00:06:13.641 real 0m2.966s 00:06:13.641 user 0m2.662s 00:06:13.641 sys 0m0.296s 00:06:13.641 07:04:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.641 07:04:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.641 ************************************ 00:06:13.641 END TEST accel_dif_generate 00:06:13.641 ************************************ 00:06:13.641 07:04:16 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:13.641 07:04:16 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:13.641 07:04:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.641 07:04:16 -- common/autotest_common.sh@10 -- # set +x 00:06:13.641 ************************************ 00:06:13.641 START TEST accel_dif_generate_copy 00:06:13.641 ************************************ 00:06:13.641 07:04:16 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:06:13.641 07:04:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.641 07:04:16 -- accel/accel.sh@17 -- # local accel_module 00:06:13.641 07:04:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:13.641 07:04:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:13.641 07:04:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.641 07:04:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.641 07:04:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.641 07:04:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.641 07:04:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.641 07:04:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.641 07:04:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.641 07:04:16 -- accel/accel.sh@42 -- # jq -r . 00:06:13.641 [2024-10-16 07:04:16.308437] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:13.641 [2024-10-16 07:04:16.308521] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1794751 ] 00:06:13.641 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.641 [2024-10-16 07:04:16.370399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.641 [2024-10-16 07:04:16.491018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.013 07:04:17 -- accel/accel.sh@18 -- # out=' 00:06:15.013 SPDK Configuration: 00:06:15.013 Core mask: 0x1 00:06:15.013 00:06:15.013 Accel Perf Configuration: 00:06:15.013 Workload Type: dif_generate_copy 00:06:15.013 Vector size: 4096 bytes 00:06:15.013 Transfer size: 4096 bytes 00:06:15.013 Vector count 1 00:06:15.013 Module: software 00:06:15.013 Queue depth: 32 00:06:15.013 Allocate depth: 32 00:06:15.013 # threads/core: 1 00:06:15.013 Run time: 1 seconds 00:06:15.013 Verify: No 00:06:15.014 00:06:15.014 Running for 1 seconds... 00:06:15.014 00:06:15.014 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.014 ------------------------------------------------------------------------------------ 00:06:15.014 0,0 76192/s 302 MiB/s 0 0 00:06:15.014 ==================================================================================== 00:06:15.014 Total 76192/s 297 MiB/s 0 0' 00:06:15.014 07:04:17 -- accel/accel.sh@20 -- # IFS=: 00:06:15.014 07:04:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:15.014 07:04:17 -- accel/accel.sh@20 -- # read -r var val 00:06:15.014 07:04:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:15.014 07:04:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.014 07:04:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.014 07:04:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.014 07:04:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.014 07:04:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.014 07:04:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.014 07:04:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.014 07:04:17 -- accel/accel.sh@42 -- # jq -r . 00:06:15.014 [2024-10-16 07:04:17.794168] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:15.014 [2024-10-16 07:04:17.794251] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1794889 ] 00:06:15.014 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.014 [2024-10-16 07:04:17.860119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.272 [2024-10-16 07:04:17.979629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val=0x1 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val=software 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.272 07:04:18 -- accel/accel.sh@21 -- # val=32 00:06:15.272 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.272 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val=32 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val=1 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val=No 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:15.273 07:04:18 -- accel/accel.sh@21 -- # val= 00:06:15.273 07:04:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:15.273 07:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@21 -- # val= 00:06:16.648 07:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:16.648 07:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:16.648 07:04:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.648 07:04:19 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:16.648 07:04:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.648 00:06:16.648 real 0m2.956s 00:06:16.648 user 0m2.658s 00:06:16.648 sys 0m0.289s 00:06:16.648 07:04:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:16.648 07:04:19 -- common/autotest_common.sh@10 -- # set +x 00:06:16.648 ************************************ 00:06:16.648 END TEST accel_dif_generate_copy 00:06:16.648 ************************************ 00:06:16.648 07:04:19 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:16.648 07:04:19 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.648 07:04:19 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:16.648 07:04:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.648 07:04:19 -- common/autotest_common.sh@10 -- # set +x 00:06:16.648 ************************************ 00:06:16.648 START TEST accel_comp 00:06:16.648 ************************************ 00:06:16.648 07:04:19 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.648 07:04:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.648 07:04:19 -- accel/accel.sh@17 -- # local accel_module 00:06:16.648 07:04:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.648 07:04:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.648 07:04:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.648 07:04:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.648 07:04:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.648 07:04:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.648 07:04:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.648 07:04:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.648 07:04:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.648 07:04:19 -- accel/accel.sh@42 -- # jq -r . 00:06:16.648 [2024-10-16 07:04:19.289830] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:16.648 [2024-10-16 07:04:19.289911] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1795053 ] 00:06:16.648 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.648 [2024-10-16 07:04:19.352659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.648 [2024-10-16 07:04:19.473194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.023 07:04:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.023 00:06:18.023 SPDK Configuration: 00:06:18.023 Core mask: 0x1 00:06:18.023 00:06:18.023 Accel Perf Configuration: 00:06:18.023 Workload Type: compress 00:06:18.023 Transfer size: 4096 bytes 00:06:18.023 Vector count 1 00:06:18.023 Module: software 00:06:18.023 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.023 Queue depth: 32 00:06:18.023 Allocate depth: 32 00:06:18.023 # threads/core: 1 00:06:18.023 Run time: 1 seconds 00:06:18.023 Verify: No 00:06:18.023 00:06:18.023 Running for 1 seconds... 00:06:18.023 00:06:18.023 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.023 ------------------------------------------------------------------------------------ 00:06:18.023 0,0 31424/s 130 MiB/s 0 0 00:06:18.023 ==================================================================================== 00:06:18.023 Total 31424/s 122 MiB/s 0 0' 00:06:18.023 07:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:18.023 07:04:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.023 07:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:18.023 07:04:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.023 07:04:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.023 07:04:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.023 07:04:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.023 07:04:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.023 07:04:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.023 07:04:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.023 07:04:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.023 07:04:20 -- accel/accel.sh@42 -- # jq -r . 00:06:18.023 [2024-10-16 07:04:20.775098] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:18.023 [2024-10-16 07:04:20.775180] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1795267 ] 00:06:18.023 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.023 [2024-10-16 07:04:20.839890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.023 [2024-10-16 07:04:20.960948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.281 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.281 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.281 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.281 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.281 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.281 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=0x1 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=compress 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=software 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=32 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=32 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=1 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val=No 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:18.282 07:04:21 -- accel/accel.sh@21 -- # val= 00:06:18.282 07:04:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:18.282 07:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@21 -- # val= 00:06:19.656 07:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:19.656 07:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:19.656 07:04:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.656 07:04:22 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:19.656 07:04:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.656 00:06:19.656 real 0m2.980s 00:06:19.656 user 0m2.685s 00:06:19.656 sys 0m0.286s 00:06:19.656 07:04:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.656 07:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.656 ************************************ 00:06:19.656 END TEST accel_comp 00:06:19.656 ************************************ 00:06:19.656 07:04:22 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.656 07:04:22 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:19.656 07:04:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.656 07:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.656 ************************************ 00:06:19.656 START TEST accel_decomp 00:06:19.656 ************************************ 00:06:19.656 07:04:22 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.656 07:04:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.656 07:04:22 -- accel/accel.sh@17 -- # local accel_module 00:06:19.656 07:04:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.656 07:04:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.656 07:04:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.656 07:04:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.656 07:04:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.656 07:04:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.656 07:04:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.656 07:04:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.656 07:04:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.656 07:04:22 -- accel/accel.sh@42 -- # jq -r . 00:06:19.656 [2024-10-16 07:04:22.293190] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:19.656 [2024-10-16 07:04:22.293271] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1795472 ] 00:06:19.656 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.656 [2024-10-16 07:04:22.355589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.656 [2024-10-16 07:04:22.476611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.030 07:04:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.030 00:06:21.030 SPDK Configuration: 00:06:21.030 Core mask: 0x1 00:06:21.030 00:06:21.030 Accel Perf Configuration: 00:06:21.030 Workload Type: decompress 00:06:21.030 Transfer size: 4096 bytes 00:06:21.030 Vector count 1 00:06:21.030 Module: software 00:06:21.030 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.030 Queue depth: 32 00:06:21.030 Allocate depth: 32 00:06:21.030 # threads/core: 1 00:06:21.030 Run time: 1 seconds 00:06:21.030 Verify: Yes 00:06:21.030 00:06:21.030 Running for 1 seconds... 00:06:21.030 00:06:21.030 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.030 ------------------------------------------------------------------------------------ 00:06:21.030 0,0 55360/s 102 MiB/s 0 0 00:06:21.030 ==================================================================================== 00:06:21.030 Total 55360/s 216 MiB/s 0 0' 00:06:21.030 07:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:21.030 07:04:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.030 07:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:21.030 07:04:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:21.030 07:04:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.030 07:04:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.030 07:04:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.030 07:04:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.030 07:04:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.030 07:04:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.030 07:04:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.030 07:04:23 -- accel/accel.sh@42 -- # jq -r . 00:06:21.030 [2024-10-16 07:04:23.780870] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:21.030 [2024-10-16 07:04:23.780955] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1795622 ] 00:06:21.030 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.030 [2024-10-16 07:04:23.843100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.030 [2024-10-16 07:04:23.961468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=0x1 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=decompress 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=software 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=32 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=32 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=1 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val=Yes 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:21.289 07:04:24 -- accel/accel.sh@21 -- # val= 00:06:21.289 07:04:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:21.289 07:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@21 -- # val= 00:06:22.663 07:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:22.663 07:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:22.663 07:04:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.663 07:04:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.663 07:04:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.663 00:06:22.663 real 0m2.976s 00:06:22.663 user 0m2.671s 00:06:22.663 sys 0m0.297s 00:06:22.663 07:04:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.663 07:04:25 -- common/autotest_common.sh@10 -- # set +x 00:06:22.663 ************************************ 00:06:22.663 END TEST accel_decomp 00:06:22.663 ************************************ 00:06:22.663 07:04:25 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.663 07:04:25 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:22.663 07:04:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.663 07:04:25 -- common/autotest_common.sh@10 -- # set +x 00:06:22.663 ************************************ 00:06:22.663 START TEST accel_decmop_full 00:06:22.663 ************************************ 00:06:22.663 07:04:25 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.663 07:04:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:22.663 07:04:25 -- accel/accel.sh@17 -- # local accel_module 00:06:22.663 07:04:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.663 07:04:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.663 07:04:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.663 07:04:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.663 07:04:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.663 07:04:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.663 07:04:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.663 07:04:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.663 07:04:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.663 07:04:25 -- accel/accel.sh@42 -- # jq -r . 00:06:22.663 [2024-10-16 07:04:25.297432] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:22.663 [2024-10-16 07:04:25.297534] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1795809 ] 00:06:22.663 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.663 [2024-10-16 07:04:25.361787] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.663 [2024-10-16 07:04:25.481703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.038 07:04:26 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:24.038 00:06:24.038 SPDK Configuration: 00:06:24.038 Core mask: 0x1 00:06:24.038 00:06:24.038 Accel Perf Configuration: 00:06:24.038 Workload Type: decompress 00:06:24.038 Transfer size: 111250 bytes 00:06:24.038 Vector count 1 00:06:24.038 Module: software 00:06:24.038 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.038 Queue depth: 32 00:06:24.038 Allocate depth: 32 00:06:24.038 # threads/core: 1 00:06:24.038 Run time: 1 seconds 00:06:24.038 Verify: Yes 00:06:24.038 00:06:24.038 Running for 1 seconds... 00:06:24.038 00:06:24.038 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:24.038 ------------------------------------------------------------------------------------ 00:06:24.038 0,0 3776/s 155 MiB/s 0 0 00:06:24.038 ==================================================================================== 00:06:24.038 Total 3776/s 400 MiB/s 0 0' 00:06:24.038 07:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:24.038 07:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:24.038 07:04:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.038 07:04:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:24.038 07:04:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.038 07:04:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.038 07:04:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.038 07:04:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.038 07:04:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.038 07:04:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.038 07:04:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.038 07:04:26 -- accel/accel.sh@42 -- # jq -r . 00:06:24.038 [2024-10-16 07:04:26.796285] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:24.038 [2024-10-16 07:04:26.796372] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1796044 ] 00:06:24.038 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.038 [2024-10-16 07:04:26.860972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.295 [2024-10-16 07:04:26.981350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val=0x1 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val=decompress 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.295 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.295 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.295 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=software 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@23 -- # accel_module=software 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=32 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=32 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=1 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val=Yes 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:24.296 07:04:27 -- accel/accel.sh@21 -- # val= 00:06:24.296 07:04:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:24.296 07:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@21 -- # val= 00:06:25.670 07:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:25.670 07:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:25.670 07:04:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:25.670 07:04:28 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:25.670 07:04:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:25.670 00:06:25.670 real 0m3.008s 00:06:25.670 user 0m2.693s 00:06:25.670 sys 0m0.307s 00:06:25.670 07:04:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.670 07:04:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.670 ************************************ 00:06:25.670 END TEST accel_decmop_full 00:06:25.671 ************************************ 00:06:25.671 07:04:28 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.671 07:04:28 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:25.671 07:04:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.671 07:04:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.671 ************************************ 00:06:25.671 START TEST accel_decomp_mcore 00:06:25.671 ************************************ 00:06:25.671 07:04:28 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.671 07:04:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:25.671 07:04:28 -- accel/accel.sh@17 -- # local accel_module 00:06:25.671 07:04:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.671 07:04:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.671 07:04:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.671 07:04:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.671 07:04:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.671 07:04:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.671 07:04:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.671 07:04:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.671 07:04:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.671 07:04:28 -- accel/accel.sh@42 -- # jq -r . 00:06:25.671 [2024-10-16 07:04:28.328602] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:25.671 [2024-10-16 07:04:28.328684] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1796199 ] 00:06:25.671 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.671 [2024-10-16 07:04:28.389957] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:25.671 [2024-10-16 07:04:28.516997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.671 [2024-10-16 07:04:28.517049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:25.671 [2024-10-16 07:04:28.517099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:25.671 [2024-10-16 07:04:28.517103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.045 07:04:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:27.045 00:06:27.045 SPDK Configuration: 00:06:27.045 Core mask: 0xf 00:06:27.045 00:06:27.045 Accel Perf Configuration: 00:06:27.045 Workload Type: decompress 00:06:27.045 Transfer size: 4096 bytes 00:06:27.045 Vector count 1 00:06:27.045 Module: software 00:06:27.045 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.045 Queue depth: 32 00:06:27.045 Allocate depth: 32 00:06:27.045 # threads/core: 1 00:06:27.045 Run time: 1 seconds 00:06:27.045 Verify: Yes 00:06:27.045 00:06:27.045 Running for 1 seconds... 00:06:27.045 00:06:27.045 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:27.045 ------------------------------------------------------------------------------------ 00:06:27.045 0,0 50400/s 92 MiB/s 0 0 00:06:27.045 3,0 50688/s 93 MiB/s 0 0 00:06:27.045 2,0 50592/s 93 MiB/s 0 0 00:06:27.045 1,0 50464/s 92 MiB/s 0 0 00:06:27.045 ==================================================================================== 00:06:27.045 Total 202144/s 789 MiB/s 0 0' 00:06:27.045 07:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:27.045 07:04:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.045 07:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:27.045 07:04:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:27.045 07:04:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.045 07:04:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.045 07:04:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.045 07:04:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.045 07:04:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.045 07:04:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.045 07:04:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.045 07:04:29 -- accel/accel.sh@42 -- # jq -r . 00:06:27.045 [2024-10-16 07:04:29.818433] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:27.045 [2024-10-16 07:04:29.818517] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1796365 ] 00:06:27.045 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.045 [2024-10-16 07:04:29.881832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.303 [2024-10-16 07:04:30.005556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.303 [2024-10-16 07:04:30.006641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.303 [2024-10-16 07:04:30.006710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.303 [2024-10-16 07:04:30.006715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.303 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.303 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.303 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val=0xf 00:06:27.303 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.303 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.303 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.303 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=decompress 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=software 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@23 -- # accel_module=software 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=32 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=32 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=1 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val=Yes 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:27.304 07:04:30 -- accel/accel.sh@21 -- # val= 00:06:27.304 07:04:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:27.304 07:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@21 -- # val= 00:06:28.776 07:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:28.776 07:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:28.776 07:04:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:28.776 07:04:31 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:28.776 07:04:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:28.776 00:06:28.776 real 0m3.000s 00:06:28.776 user 0m9.622s 00:06:28.776 sys 0m0.306s 00:06:28.776 07:04:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:28.776 07:04:31 -- common/autotest_common.sh@10 -- # set +x 00:06:28.776 ************************************ 00:06:28.776 END TEST accel_decomp_mcore 00:06:28.776 ************************************ 00:06:28.776 07:04:31 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.776 07:04:31 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:28.776 07:04:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:28.776 07:04:31 -- common/autotest_common.sh@10 -- # set +x 00:06:28.776 ************************************ 00:06:28.776 START TEST accel_decomp_full_mcore 00:06:28.776 ************************************ 00:06:28.776 07:04:31 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.776 07:04:31 -- accel/accel.sh@16 -- # local accel_opc 00:06:28.776 07:04:31 -- accel/accel.sh@17 -- # local accel_module 00:06:28.776 07:04:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.776 07:04:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.776 07:04:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.776 07:04:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.776 07:04:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.776 07:04:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.776 07:04:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.776 07:04:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.776 07:04:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.776 07:04:31 -- accel/accel.sh@42 -- # jq -r . 00:06:28.776 [2024-10-16 07:04:31.357405] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:28.776 [2024-10-16 07:04:31.357487] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1796637 ] 00:06:28.776 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.776 [2024-10-16 07:04:31.419706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:28.776 [2024-10-16 07:04:31.544741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.776 [2024-10-16 07:04:31.544784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.776 [2024-10-16 07:04:31.544838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:28.776 [2024-10-16 07:04:31.544841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.150 07:04:32 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:30.150 00:06:30.150 SPDK Configuration: 00:06:30.150 Core mask: 0xf 00:06:30.150 00:06:30.150 Accel Perf Configuration: 00:06:30.150 Workload Type: decompress 00:06:30.150 Transfer size: 111250 bytes 00:06:30.150 Vector count 1 00:06:30.150 Module: software 00:06:30.150 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:30.150 Queue depth: 32 00:06:30.150 Allocate depth: 32 00:06:30.150 # threads/core: 1 00:06:30.150 Run time: 1 seconds 00:06:30.150 Verify: Yes 00:06:30.150 00:06:30.150 Running for 1 seconds... 00:06:30.150 00:06:30.150 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:30.150 ------------------------------------------------------------------------------------ 00:06:30.150 0,0 3776/s 155 MiB/s 0 0 00:06:30.150 3,0 3776/s 155 MiB/s 0 0 00:06:30.150 2,0 3776/s 155 MiB/s 0 0 00:06:30.150 1,0 3808/s 157 MiB/s 0 0 00:06:30.150 ==================================================================================== 00:06:30.150 Total 15136/s 1605 MiB/s 0 0' 00:06:30.150 07:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:30.150 07:04:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.150 07:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:30.150 07:04:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:30.150 07:04:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.150 07:04:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.150 07:04:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.150 07:04:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.150 07:04:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.150 07:04:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.150 07:04:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.150 07:04:32 -- accel/accel.sh@42 -- # jq -r . 00:06:30.150 [2024-10-16 07:04:32.872595] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:30.150 [2024-10-16 07:04:32.872678] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1796784 ] 00:06:30.150 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.150 [2024-10-16 07:04:32.933773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:30.150 [2024-10-16 07:04:33.054921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.150 [2024-10-16 07:04:33.054978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.150 [2024-10-16 07:04:33.055031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:30.150 [2024-10-16 07:04:33.055035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=0xf 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=decompress 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=software 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=32 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=32 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=1 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val=Yes 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:30.409 07:04:33 -- accel/accel.sh@21 -- # val= 00:06:30.409 07:04:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:30.409 07:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.783 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@21 -- # val= 00:06:31.784 07:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:31.784 07:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:31.784 07:04:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:31.784 07:04:34 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:31.784 07:04:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:31.784 00:06:31.784 real 0m3.025s 00:06:31.784 user 0m9.740s 00:06:31.784 sys 0m0.308s 00:06:31.784 07:04:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:31.784 07:04:34 -- common/autotest_common.sh@10 -- # set +x 00:06:31.784 ************************************ 00:06:31.784 END TEST accel_decomp_full_mcore 00:06:31.784 ************************************ 00:06:31.784 07:04:34 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.784 07:04:34 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:31.784 07:04:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:31.784 07:04:34 -- common/autotest_common.sh@10 -- # set +x 00:06:31.784 ************************************ 00:06:31.784 START TEST accel_decomp_mthread 00:06:31.784 ************************************ 00:06:31.784 07:04:34 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.784 07:04:34 -- accel/accel.sh@16 -- # local accel_opc 00:06:31.784 07:04:34 -- accel/accel.sh@17 -- # local accel_module 00:06:31.784 07:04:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.784 07:04:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.784 07:04:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.784 07:04:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.784 07:04:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.784 07:04:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.784 07:04:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.784 07:04:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.784 07:04:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.784 07:04:34 -- accel/accel.sh@42 -- # jq -r . 00:06:31.784 [2024-10-16 07:04:34.406491] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:31.784 [2024-10-16 07:04:34.406568] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797036 ] 00:06:31.784 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.784 [2024-10-16 07:04:34.472475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.784 [2024-10-16 07:04:34.590748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.241 07:04:35 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:33.241 00:06:33.241 SPDK Configuration: 00:06:33.241 Core mask: 0x1 00:06:33.241 00:06:33.241 Accel Perf Configuration: 00:06:33.241 Workload Type: decompress 00:06:33.241 Transfer size: 4096 bytes 00:06:33.241 Vector count 1 00:06:33.241 Module: software 00:06:33.242 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:33.242 Queue depth: 32 00:06:33.242 Allocate depth: 32 00:06:33.242 # threads/core: 2 00:06:33.242 Run time: 1 seconds 00:06:33.242 Verify: Yes 00:06:33.242 00:06:33.242 Running for 1 seconds... 00:06:33.242 00:06:33.242 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:33.242 ------------------------------------------------------------------------------------ 00:06:33.242 0,1 28032/s 51 MiB/s 0 0 00:06:33.242 0,0 27936/s 51 MiB/s 0 0 00:06:33.242 ==================================================================================== 00:06:33.242 Total 55968/s 218 MiB/s 0 0' 00:06:33.242 07:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.242 07:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:33.242 07:04:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.242 07:04:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.242 07:04:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.242 07:04:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.242 07:04:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.242 07:04:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.242 07:04:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.242 07:04:35 -- accel/accel.sh@42 -- # jq -r . 00:06:33.242 [2024-10-16 07:04:35.892913] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:33.242 [2024-10-16 07:04:35.892998] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797215 ] 00:06:33.242 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.242 [2024-10-16 07:04:35.954228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.242 [2024-10-16 07:04:36.074743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=0x1 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=decompress 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=software 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@23 -- # accel_module=software 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=32 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=32 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=2 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val=Yes 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.242 07:04:36 -- accel/accel.sh@21 -- # val= 00:06:33.242 07:04:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.242 07:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@21 -- # val= 00:06:34.615 07:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:34.615 07:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:34.615 07:04:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:34.615 07:04:37 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:34.615 07:04:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:34.615 00:06:34.615 real 0m2.981s 00:06:34.615 user 0m2.671s 00:06:34.615 sys 0m0.302s 00:06:34.615 07:04:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:34.615 07:04:37 -- common/autotest_common.sh@10 -- # set +x 00:06:34.615 ************************************ 00:06:34.615 END TEST accel_decomp_mthread 00:06:34.615 ************************************ 00:06:34.615 07:04:37 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.615 07:04:37 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:34.615 07:04:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:34.615 07:04:37 -- common/autotest_common.sh@10 -- # set +x 00:06:34.615 ************************************ 00:06:34.615 START TEST accel_deomp_full_mthread 00:06:34.615 ************************************ 00:06:34.615 07:04:37 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.615 07:04:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:34.615 07:04:37 -- accel/accel.sh@17 -- # local accel_module 00:06:34.615 07:04:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.615 07:04:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.615 07:04:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.615 07:04:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.615 07:04:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.615 07:04:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.615 07:04:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.615 07:04:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.615 07:04:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.616 07:04:37 -- accel/accel.sh@42 -- # jq -r . 00:06:34.616 [2024-10-16 07:04:37.415943] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:34.616 [2024-10-16 07:04:37.416025] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797370 ] 00:06:34.616 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.616 [2024-10-16 07:04:37.476682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.874 [2024-10-16 07:04:37.597920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.246 07:04:38 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:36.246 00:06:36.246 SPDK Configuration: 00:06:36.246 Core mask: 0x1 00:06:36.246 00:06:36.246 Accel Perf Configuration: 00:06:36.246 Workload Type: decompress 00:06:36.246 Transfer size: 111250 bytes 00:06:36.246 Vector count 1 00:06:36.246 Module: software 00:06:36.246 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:36.246 Queue depth: 32 00:06:36.246 Allocate depth: 32 00:06:36.246 # threads/core: 2 00:06:36.246 Run time: 1 seconds 00:06:36.246 Verify: Yes 00:06:36.246 00:06:36.246 Running for 1 seconds... 00:06:36.246 00:06:36.246 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:36.246 ------------------------------------------------------------------------------------ 00:06:36.246 0,1 1952/s 80 MiB/s 0 0 00:06:36.246 0,0 1920/s 79 MiB/s 0 0 00:06:36.246 ==================================================================================== 00:06:36.246 Total 3872/s 410 MiB/s 0 0' 00:06:36.246 07:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:36.246 07:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:36.246 07:04:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.246 07:04:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:36.246 07:04:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.246 07:04:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.246 07:04:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.246 07:04:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.246 07:04:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.246 07:04:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.246 07:04:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.246 07:04:38 -- accel/accel.sh@42 -- # jq -r . 00:06:36.246 [2024-10-16 07:04:38.931768] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:36.246 [2024-10-16 07:04:38.931854] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797546 ] 00:06:36.246 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.246 [2024-10-16 07:04:38.992666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.246 [2024-10-16 07:04:39.113383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.246 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.246 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.246 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.246 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.246 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.246 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.246 07:04:39 -- accel/accel.sh@21 -- # val=0x1 00:06:36.246 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.246 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=decompress 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=software 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@23 -- # accel_module=software 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=32 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=32 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=2 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val=Yes 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.247 07:04:39 -- accel/accel.sh@21 -- # val= 00:06:36.247 07:04:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.247 07:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@21 -- # val= 00:06:37.617 07:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:37.617 07:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:37.617 07:04:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:37.617 07:04:40 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:37.617 07:04:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:37.617 00:06:37.617 real 0m3.033s 00:06:37.617 user 0m2.739s 00:06:37.617 sys 0m0.284s 00:06:37.617 07:04:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:37.617 07:04:40 -- common/autotest_common.sh@10 -- # set +x 00:06:37.617 ************************************ 00:06:37.617 END TEST accel_deomp_full_mthread 00:06:37.617 ************************************ 00:06:37.617 07:04:40 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:37.617 07:04:40 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:37.617 07:04:40 -- accel/accel.sh@129 -- # build_accel_config 00:06:37.617 07:04:40 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:37.617 07:04:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.617 07:04:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:37.617 07:04:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.617 07:04:40 -- common/autotest_common.sh@10 -- # set +x 00:06:37.617 07:04:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.617 07:04:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.617 07:04:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.617 07:04:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.617 07:04:40 -- accel/accel.sh@42 -- # jq -r . 00:06:37.617 ************************************ 00:06:37.617 START TEST accel_dif_functional_tests 00:06:37.617 ************************************ 00:06:37.617 07:04:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:37.617 [2024-10-16 07:04:40.494223] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:37.617 [2024-10-16 07:04:40.494314] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797798 ] 00:06:37.617 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.618 [2024-10-16 07:04:40.558288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:37.876 [2024-10-16 07:04:40.683927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:37.876 [2024-10-16 07:04:40.683982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:37.876 [2024-10-16 07:04:40.683986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.876 00:06:37.876 00:06:37.876 CUnit - A unit testing framework for C - Version 2.1-3 00:06:37.876 http://cunit.sourceforge.net/ 00:06:37.876 00:06:37.876 00:06:37.876 Suite: accel_dif 00:06:37.876 Test: verify: DIF generated, GUARD check ...passed 00:06:37.876 Test: verify: DIF generated, APPTAG check ...passed 00:06:37.876 Test: verify: DIF generated, REFTAG check ...passed 00:06:37.876 Test: verify: DIF not generated, GUARD check ...[2024-10-16 07:04:40.786597] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:37.876 [2024-10-16 07:04:40.786666] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:37.876 passed 00:06:37.876 Test: verify: DIF not generated, APPTAG check ...[2024-10-16 07:04:40.786709] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:37.876 [2024-10-16 07:04:40.786749] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:37.876 passed 00:06:37.876 Test: verify: DIF not generated, REFTAG check ...[2024-10-16 07:04:40.786785] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:37.876 [2024-10-16 07:04:40.786815] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:37.876 passed 00:06:37.876 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:37.876 Test: verify: APPTAG incorrect, APPTAG check ...[2024-10-16 07:04:40.786883] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:37.876 passed 00:06:37.876 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:37.876 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:37.876 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:37.876 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-10-16 07:04:40.787038] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:37.876 passed 00:06:37.876 Test: generate copy: DIF generated, GUARD check ...passed 00:06:37.876 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:37.876 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:37.876 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:37.876 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:37.876 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:37.876 Test: generate copy: iovecs-len validate ...[2024-10-16 07:04:40.787293] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:37.876 passed 00:06:37.876 Test: generate copy: buffer alignment validate ...passed 00:06:37.876 00:06:37.876 Run Summary: Type Total Ran Passed Failed Inactive 00:06:37.876 suites 1 1 n/a 0 0 00:06:37.876 tests 20 20 20 0 0 00:06:37.876 asserts 204 204 204 0 n/a 00:06:37.876 00:06:37.876 Elapsed time = 0.003 seconds 00:06:38.134 00:06:38.134 real 0m0.599s 00:06:38.134 user 0m0.908s 00:06:38.134 sys 0m0.187s 00:06:38.134 07:04:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.134 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.134 ************************************ 00:06:38.134 END TEST accel_dif_functional_tests 00:06:38.134 ************************************ 00:06:38.392 00:06:38.392 real 1m3.295s 00:06:38.392 user 1m11.118s 00:06:38.392 sys 0m7.292s 00:06:38.392 07:04:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.392 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.392 ************************************ 00:06:38.392 END TEST accel 00:06:38.392 ************************************ 00:06:38.392 07:04:41 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:38.392 07:04:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:38.392 07:04:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.392 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.392 ************************************ 00:06:38.392 START TEST accel_rpc 00:06:38.392 ************************************ 00:06:38.392 07:04:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:38.392 * Looking for test storage... 00:06:38.392 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:38.392 07:04:41 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:38.392 07:04:41 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1797875 00:06:38.392 07:04:41 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:38.392 07:04:41 -- accel/accel_rpc.sh@15 -- # waitforlisten 1797875 00:06:38.392 07:04:41 -- common/autotest_common.sh@819 -- # '[' -z 1797875 ']' 00:06:38.392 07:04:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.392 07:04:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:38.392 07:04:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.392 07:04:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:38.392 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.392 [2024-10-16 07:04:41.209466] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:38.392 [2024-10-16 07:04:41.209555] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1797875 ] 00:06:38.392 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.392 [2024-10-16 07:04:41.272925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.650 [2024-10-16 07:04:41.390454] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.650 [2024-10-16 07:04:41.390633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.650 07:04:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:38.650 07:04:41 -- common/autotest_common.sh@852 -- # return 0 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:38.650 07:04:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:38.650 07:04:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.650 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.650 ************************************ 00:06:38.650 START TEST accel_assign_opcode 00:06:38.650 ************************************ 00:06:38.650 07:04:41 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:38.650 07:04:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.650 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.650 [2024-10-16 07:04:41.431182] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:38.650 07:04:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:38.650 07:04:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.650 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.650 [2024-10-16 07:04:41.439193] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:38.650 07:04:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.650 07:04:41 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:38.650 07:04:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.650 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.908 07:04:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.908 07:04:41 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:38.908 07:04:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.908 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.908 07:04:41 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:38.908 07:04:41 -- accel/accel_rpc.sh@42 -- # grep software 00:06:38.908 07:04:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.908 software 00:06:38.908 00:06:38.908 real 0m0.295s 00:06:38.908 user 0m0.040s 00:06:38.908 sys 0m0.006s 00:06:38.908 07:04:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.908 07:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.908 ************************************ 00:06:38.908 END TEST accel_assign_opcode 00:06:38.908 ************************************ 00:06:38.908 07:04:41 -- accel/accel_rpc.sh@55 -- # killprocess 1797875 00:06:38.908 07:04:41 -- common/autotest_common.sh@926 -- # '[' -z 1797875 ']' 00:06:38.908 07:04:41 -- common/autotest_common.sh@930 -- # kill -0 1797875 00:06:38.908 07:04:41 -- common/autotest_common.sh@931 -- # uname 00:06:38.908 07:04:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:38.908 07:04:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1797875 00:06:38.908 07:04:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:38.908 07:04:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:38.908 07:04:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1797875' 00:06:38.908 killing process with pid 1797875 00:06:38.908 07:04:41 -- common/autotest_common.sh@945 -- # kill 1797875 00:06:38.908 07:04:41 -- common/autotest_common.sh@950 -- # wait 1797875 00:06:39.473 00:06:39.473 real 0m1.150s 00:06:39.473 user 0m1.096s 00:06:39.473 sys 0m0.414s 00:06:39.473 07:04:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:39.473 07:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:39.473 ************************************ 00:06:39.473 END TEST accel_rpc 00:06:39.473 ************************************ 00:06:39.473 07:04:42 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:39.473 07:04:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:39.473 07:04:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:39.473 07:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:39.473 ************************************ 00:06:39.473 START TEST app_cmdline 00:06:39.473 ************************************ 00:06:39.473 07:04:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:39.473 * Looking for test storage... 00:06:39.473 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.473 07:04:42 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:39.473 07:04:42 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1798125 00:06:39.473 07:04:42 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:39.473 07:04:42 -- app/cmdline.sh@18 -- # waitforlisten 1798125 00:06:39.473 07:04:42 -- common/autotest_common.sh@819 -- # '[' -z 1798125 ']' 00:06:39.473 07:04:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.473 07:04:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:39.473 07:04:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.473 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.473 07:04:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:39.473 07:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:39.473 [2024-10-16 07:04:42.392406] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:39.473 [2024-10-16 07:04:42.392502] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1798125 ] 00:06:39.731 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.731 [2024-10-16 07:04:42.456223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.731 [2024-10-16 07:04:42.567557] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.731 [2024-10-16 07:04:42.567766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.663 07:04:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:40.663 07:04:43 -- common/autotest_common.sh@852 -- # return 0 00:06:40.663 07:04:43 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:40.921 { 00:06:40.921 "version": "SPDK v24.01.1-pre git sha1 726a04d70", 00:06:40.921 "fields": { 00:06:40.921 "major": 24, 00:06:40.921 "minor": 1, 00:06:40.921 "patch": 1, 00:06:40.921 "suffix": "-pre", 00:06:40.921 "commit": "726a04d70" 00:06:40.921 } 00:06:40.921 } 00:06:40.921 07:04:43 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:40.921 07:04:43 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:40.921 07:04:43 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:40.921 07:04:43 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:40.921 07:04:43 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:40.921 07:04:43 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:40.921 07:04:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.921 07:04:43 -- app/cmdline.sh@26 -- # sort 00:06:40.921 07:04:43 -- common/autotest_common.sh@10 -- # set +x 00:06:40.921 07:04:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.921 07:04:43 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:40.921 07:04:43 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:40.921 07:04:43 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:40.921 07:04:43 -- common/autotest_common.sh@640 -- # local es=0 00:06:40.921 07:04:43 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:40.921 07:04:43 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.921 07:04:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:40.921 07:04:43 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.921 07:04:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:40.921 07:04:43 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.921 07:04:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:40.921 07:04:43 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:40.921 07:04:43 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:40.921 07:04:43 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:41.177 request: 00:06:41.177 { 00:06:41.177 "method": "env_dpdk_get_mem_stats", 00:06:41.177 "req_id": 1 00:06:41.177 } 00:06:41.177 Got JSON-RPC error response 00:06:41.177 response: 00:06:41.177 { 00:06:41.177 "code": -32601, 00:06:41.177 "message": "Method not found" 00:06:41.177 } 00:06:41.177 07:04:43 -- common/autotest_common.sh@643 -- # es=1 00:06:41.177 07:04:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:41.177 07:04:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:41.177 07:04:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:41.177 07:04:43 -- app/cmdline.sh@1 -- # killprocess 1798125 00:06:41.177 07:04:43 -- common/autotest_common.sh@926 -- # '[' -z 1798125 ']' 00:06:41.177 07:04:43 -- common/autotest_common.sh@930 -- # kill -0 1798125 00:06:41.177 07:04:43 -- common/autotest_common.sh@931 -- # uname 00:06:41.177 07:04:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:41.177 07:04:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1798125 00:06:41.177 07:04:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:41.177 07:04:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:41.177 07:04:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1798125' 00:06:41.177 killing process with pid 1798125 00:06:41.177 07:04:44 -- common/autotest_common.sh@945 -- # kill 1798125 00:06:41.177 07:04:44 -- common/autotest_common.sh@950 -- # wait 1798125 00:06:41.742 00:06:41.742 real 0m2.202s 00:06:41.742 user 0m2.802s 00:06:41.742 sys 0m0.528s 00:06:41.742 07:04:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:41.742 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.742 ************************************ 00:06:41.742 END TEST app_cmdline 00:06:41.742 ************************************ 00:06:41.742 07:04:44 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:41.742 07:04:44 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:41.742 07:04:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.742 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.742 ************************************ 00:06:41.742 START TEST version 00:06:41.742 ************************************ 00:06:41.742 07:04:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:41.742 * Looking for test storage... 00:06:41.742 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:41.742 07:04:44 -- app/version.sh@17 -- # get_header_version major 00:06:41.742 07:04:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:41.742 07:04:44 -- app/version.sh@14 -- # cut -f2 00:06:41.742 07:04:44 -- app/version.sh@14 -- # tr -d '"' 00:06:41.742 07:04:44 -- app/version.sh@17 -- # major=24 00:06:41.742 07:04:44 -- app/version.sh@18 -- # get_header_version minor 00:06:41.742 07:04:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:41.742 07:04:44 -- app/version.sh@14 -- # cut -f2 00:06:41.742 07:04:44 -- app/version.sh@14 -- # tr -d '"' 00:06:41.742 07:04:44 -- app/version.sh@18 -- # minor=1 00:06:41.742 07:04:44 -- app/version.sh@19 -- # get_header_version patch 00:06:41.742 07:04:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:41.742 07:04:44 -- app/version.sh@14 -- # cut -f2 00:06:41.742 07:04:44 -- app/version.sh@14 -- # tr -d '"' 00:06:41.742 07:04:44 -- app/version.sh@19 -- # patch=1 00:06:41.742 07:04:44 -- app/version.sh@20 -- # get_header_version suffix 00:06:41.742 07:04:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:41.742 07:04:44 -- app/version.sh@14 -- # cut -f2 00:06:41.742 07:04:44 -- app/version.sh@14 -- # tr -d '"' 00:06:41.742 07:04:44 -- app/version.sh@20 -- # suffix=-pre 00:06:41.742 07:04:44 -- app/version.sh@22 -- # version=24.1 00:06:41.742 07:04:44 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:41.742 07:04:44 -- app/version.sh@25 -- # version=24.1.1 00:06:41.742 07:04:44 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:41.742 07:04:44 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:41.742 07:04:44 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:41.742 07:04:44 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:41.742 07:04:44 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:41.742 00:06:41.742 real 0m0.104s 00:06:41.742 user 0m0.059s 00:06:41.742 sys 0m0.067s 00:06:41.742 07:04:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:41.742 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.742 ************************************ 00:06:41.742 END TEST version 00:06:41.742 ************************************ 00:06:41.742 07:04:44 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@204 -- # uname -s 00:06:41.742 07:04:44 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:06:41.742 07:04:44 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:41.742 07:04:44 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:41.742 07:04:44 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@268 -- # timing_exit lib 00:06:41.742 07:04:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:41.742 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.742 07:04:44 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:06:41.742 07:04:44 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:06:41.742 07:04:44 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:41.742 07:04:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:41.742 07:04:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.742 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.742 ************************************ 00:06:41.742 START TEST nvmf_tcp 00:06:41.742 ************************************ 00:06:41.742 07:04:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:42.001 * Looking for test storage... 00:06:42.001 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:42.001 07:04:44 -- nvmf/common.sh@7 -- # uname -s 00:06:42.001 07:04:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:42.001 07:04:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:42.001 07:04:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:42.001 07:04:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:42.001 07:04:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:42.001 07:04:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:42.001 07:04:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:42.001 07:04:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:42.001 07:04:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:42.001 07:04:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:42.001 07:04:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.001 07:04:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.001 07:04:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:42.001 07:04:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:42.001 07:04:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:42.001 07:04:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:42.001 07:04:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:42.001 07:04:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:42.001 07:04:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:42.001 07:04:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@5 -- # export PATH 00:06:42.001 07:04:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- nvmf/common.sh@46 -- # : 0 00:06:42.001 07:04:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:42.001 07:04:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:42.001 07:04:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:42.001 07:04:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:42.001 07:04:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:42.001 07:04:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:42.001 07:04:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:42.001 07:04:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:42.001 07:04:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:42.001 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:42.001 07:04:44 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:42.001 07:04:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:42.001 07:04:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:42.001 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:42.001 ************************************ 00:06:42.001 START TEST nvmf_example 00:06:42.001 ************************************ 00:06:42.001 07:04:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:42.001 * Looking for test storage... 00:06:42.001 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:42.001 07:04:44 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:42.001 07:04:44 -- nvmf/common.sh@7 -- # uname -s 00:06:42.001 07:04:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:42.001 07:04:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:42.001 07:04:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:42.001 07:04:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:42.001 07:04:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:42.001 07:04:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:42.001 07:04:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:42.001 07:04:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:42.001 07:04:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:42.001 07:04:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:42.001 07:04:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.001 07:04:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:42.001 07:04:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:42.001 07:04:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:42.001 07:04:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:42.001 07:04:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:42.001 07:04:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:42.001 07:04:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:42.001 07:04:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:42.001 07:04:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.001 07:04:44 -- paths/export.sh@5 -- # export PATH 00:06:42.002 07:04:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:42.002 07:04:44 -- nvmf/common.sh@46 -- # : 0 00:06:42.002 07:04:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:42.002 07:04:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:42.002 07:04:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:42.002 07:04:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:42.002 07:04:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:42.002 07:04:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:42.002 07:04:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:42.002 07:04:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:42.002 07:04:44 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:42.002 07:04:44 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:42.002 07:04:44 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:42.002 07:04:44 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:42.002 07:04:44 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:42.002 07:04:44 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:42.002 07:04:44 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:42.002 07:04:44 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:42.002 07:04:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:42.002 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:42.002 07:04:44 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:42.002 07:04:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:42.002 07:04:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:42.002 07:04:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:42.002 07:04:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:42.002 07:04:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:42.002 07:04:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:42.002 07:04:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:42.002 07:04:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:42.002 07:04:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:42.002 07:04:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:42.002 07:04:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:42.002 07:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:43.900 07:04:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:43.900 07:04:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:43.900 07:04:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:43.900 07:04:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:43.900 07:04:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:43.900 07:04:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:43.900 07:04:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:43.900 07:04:46 -- nvmf/common.sh@294 -- # net_devs=() 00:06:43.900 07:04:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:43.900 07:04:46 -- nvmf/common.sh@295 -- # e810=() 00:06:43.900 07:04:46 -- nvmf/common.sh@295 -- # local -ga e810 00:06:43.900 07:04:46 -- nvmf/common.sh@296 -- # x722=() 00:06:43.900 07:04:46 -- nvmf/common.sh@296 -- # local -ga x722 00:06:43.900 07:04:46 -- nvmf/common.sh@297 -- # mlx=() 00:06:43.900 07:04:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:43.900 07:04:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:43.900 07:04:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:43.900 07:04:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:43.900 07:04:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:43.900 07:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:43.900 07:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:43.900 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:43.900 07:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:43.900 07:04:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:43.900 07:04:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:43.900 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:43.900 07:04:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:43.901 07:04:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:43.901 07:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:43.901 07:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:43.901 07:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:43.901 07:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:43.901 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:43.901 07:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:43.901 07:04:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:43.901 07:04:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:43.901 07:04:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:43.901 07:04:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:43.901 07:04:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:43.901 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:43.901 07:04:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:43.901 07:04:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:43.901 07:04:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:43.901 07:04:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:43.901 07:04:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:43.901 07:04:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:43.901 07:04:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:43.901 07:04:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:43.901 07:04:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:43.901 07:04:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:43.901 07:04:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:43.901 07:04:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:43.901 07:04:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:43.901 07:04:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:44.159 07:04:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:44.159 07:04:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:44.159 07:04:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:44.159 07:04:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:44.159 07:04:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:44.159 07:04:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:44.159 07:04:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:44.159 07:04:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:44.159 07:04:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:44.159 07:04:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:44.159 07:04:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:44.159 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:44.159 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:06:44.159 00:06:44.159 --- 10.0.0.2 ping statistics --- 00:06:44.159 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.159 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:06:44.159 07:04:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:44.159 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:44.159 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:06:44.159 00:06:44.159 --- 10.0.0.1 ping statistics --- 00:06:44.159 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.159 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:06:44.159 07:04:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:44.159 07:04:46 -- nvmf/common.sh@410 -- # return 0 00:06:44.159 07:04:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:44.159 07:04:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:44.159 07:04:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:44.159 07:04:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:44.159 07:04:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:44.159 07:04:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:44.159 07:04:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:44.159 07:04:46 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:44.159 07:04:46 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:44.159 07:04:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:44.159 07:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:44.159 07:04:46 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:44.159 07:04:46 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:44.159 07:04:46 -- target/nvmf_example.sh@34 -- # nvmfpid=1800232 00:06:44.159 07:04:46 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:44.159 07:04:46 -- target/nvmf_example.sh@36 -- # waitforlisten 1800232 00:06:44.159 07:04:46 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:44.159 07:04:46 -- common/autotest_common.sh@819 -- # '[' -z 1800232 ']' 00:06:44.159 07:04:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.159 07:04:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:44.159 07:04:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.159 07:04:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:44.159 07:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:44.159 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.090 07:04:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:45.090 07:04:48 -- common/autotest_common.sh@852 -- # return 0 00:06:45.090 07:04:48 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:45.090 07:04:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:45.090 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.090 07:04:48 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:45.090 07:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:45.090 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.348 07:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:45.348 07:04:48 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:45.348 07:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:45.348 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.348 07:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:45.348 07:04:48 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:45.348 07:04:48 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:45.348 07:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:45.348 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.348 07:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:45.348 07:04:48 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:45.348 07:04:48 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:45.348 07:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:45.348 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.348 07:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:45.348 07:04:48 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:45.348 07:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:45.348 07:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:45.348 07:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:45.348 07:04:48 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:45.348 07:04:48 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:45.348 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.543 Initializing NVMe Controllers 00:06:57.543 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:57.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:57.543 Initialization complete. Launching workers. 00:06:57.543 ======================================================== 00:06:57.543 Latency(us) 00:06:57.543 Device Information : IOPS MiB/s Average min max 00:06:57.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14525.72 56.74 4405.61 759.17 20450.91 00:06:57.543 ======================================================== 00:06:57.543 Total : 14525.72 56.74 4405.61 759.17 20450.91 00:06:57.543 00:06:57.543 07:04:58 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:57.543 07:04:58 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:57.543 07:04:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:57.543 07:04:58 -- nvmf/common.sh@116 -- # sync 00:06:57.543 07:04:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:57.543 07:04:58 -- nvmf/common.sh@119 -- # set +e 00:06:57.543 07:04:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:57.543 07:04:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:57.543 rmmod nvme_tcp 00:06:57.543 rmmod nvme_fabrics 00:06:57.543 rmmod nvme_keyring 00:06:57.543 07:04:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:57.543 07:04:58 -- nvmf/common.sh@123 -- # set -e 00:06:57.543 07:04:58 -- nvmf/common.sh@124 -- # return 0 00:06:57.543 07:04:58 -- nvmf/common.sh@477 -- # '[' -n 1800232 ']' 00:06:57.543 07:04:58 -- nvmf/common.sh@478 -- # killprocess 1800232 00:06:57.543 07:04:58 -- common/autotest_common.sh@926 -- # '[' -z 1800232 ']' 00:06:57.543 07:04:58 -- common/autotest_common.sh@930 -- # kill -0 1800232 00:06:57.543 07:04:58 -- common/autotest_common.sh@931 -- # uname 00:06:57.543 07:04:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:57.543 07:04:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1800232 00:06:57.543 07:04:58 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:57.543 07:04:58 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:57.543 07:04:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1800232' 00:06:57.543 killing process with pid 1800232 00:06:57.543 07:04:58 -- common/autotest_common.sh@945 -- # kill 1800232 00:06:57.543 07:04:58 -- common/autotest_common.sh@950 -- # wait 1800232 00:06:57.543 nvmf threads initialize successfully 00:06:57.543 bdev subsystem init successfully 00:06:57.543 created a nvmf target service 00:06:57.544 create targets's poll groups done 00:06:57.544 all subsystems of target started 00:06:57.544 nvmf target is running 00:06:57.544 all subsystems of target stopped 00:06:57.544 destroy targets's poll groups done 00:06:57.544 destroyed the nvmf target service 00:06:57.544 bdev subsystem finish successfully 00:06:57.544 nvmf threads destroy successfully 00:06:57.544 07:04:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:57.544 07:04:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:57.544 07:04:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:57.544 07:04:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:57.544 07:04:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:57.544 07:04:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:57.544 07:04:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:57.544 07:04:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:57.803 07:05:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:57.803 07:05:00 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:57.803 07:05:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:57.803 07:05:00 -- common/autotest_common.sh@10 -- # set +x 00:06:58.064 00:06:58.064 real 0m16.009s 00:06:58.064 user 0m44.689s 00:06:58.064 sys 0m3.567s 00:06:58.064 07:05:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:58.064 07:05:00 -- common/autotest_common.sh@10 -- # set +x 00:06:58.064 ************************************ 00:06:58.065 END TEST nvmf_example 00:06:58.065 ************************************ 00:06:58.065 07:05:00 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:58.065 07:05:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:58.065 07:05:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:58.065 07:05:00 -- common/autotest_common.sh@10 -- # set +x 00:06:58.065 ************************************ 00:06:58.065 START TEST nvmf_filesystem 00:06:58.065 ************************************ 00:06:58.065 07:05:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:58.065 * Looking for test storage... 00:06:58.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.065 07:05:00 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:58.065 07:05:00 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:58.065 07:05:00 -- common/autotest_common.sh@34 -- # set -e 00:06:58.065 07:05:00 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:58.065 07:05:00 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:58.065 07:05:00 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:58.065 07:05:00 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:58.065 07:05:00 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:58.065 07:05:00 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:58.065 07:05:00 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:58.065 07:05:00 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:58.065 07:05:00 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:58.065 07:05:00 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:58.065 07:05:00 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:58.065 07:05:00 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:58.065 07:05:00 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:58.065 07:05:00 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:58.065 07:05:00 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:58.065 07:05:00 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:58.065 07:05:00 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:58.065 07:05:00 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:58.065 07:05:00 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:58.065 07:05:00 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:58.065 07:05:00 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:58.065 07:05:00 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:58.065 07:05:00 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:58.065 07:05:00 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:58.065 07:05:00 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:58.065 07:05:00 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:58.065 07:05:00 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:58.065 07:05:00 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:58.065 07:05:00 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:58.065 07:05:00 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:58.065 07:05:00 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:58.065 07:05:00 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:58.065 07:05:00 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:58.065 07:05:00 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:58.065 07:05:00 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:58.065 07:05:00 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:58.065 07:05:00 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:58.065 07:05:00 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:58.065 07:05:00 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:58.065 07:05:00 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:58.065 07:05:00 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:58.065 07:05:00 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:58.065 07:05:00 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:58.065 07:05:00 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:58.065 07:05:00 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:58.065 07:05:00 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:58.065 07:05:00 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:58.065 07:05:00 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:58.065 07:05:00 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:58.065 07:05:00 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:58.065 07:05:00 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:58.065 07:05:00 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:58.065 07:05:00 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:58.065 07:05:00 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:58.065 07:05:00 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:58.065 07:05:00 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:58.065 07:05:00 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:58.065 07:05:00 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:58.065 07:05:00 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:58.065 07:05:00 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:58.065 07:05:00 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:58.065 07:05:00 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:58.065 07:05:00 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:58.065 07:05:00 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:58.065 07:05:00 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:58.065 07:05:00 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:58.065 07:05:00 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:58.065 07:05:00 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:58.065 07:05:00 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:58.065 07:05:00 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:58.065 07:05:00 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:58.065 07:05:00 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:58.065 07:05:00 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:58.065 07:05:00 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:58.065 07:05:00 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:58.065 07:05:00 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:58.065 07:05:00 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:58.065 07:05:00 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:58.065 07:05:00 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:58.065 07:05:00 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:58.065 07:05:00 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:58.065 07:05:00 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:58.065 07:05:00 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.065 07:05:00 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:58.065 07:05:00 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.065 07:05:00 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:58.065 07:05:00 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:58.065 07:05:00 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:58.065 07:05:00 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:58.065 07:05:00 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:58.065 07:05:00 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:58.065 07:05:00 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:58.065 07:05:00 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:58.065 #define SPDK_CONFIG_H 00:06:58.065 #define SPDK_CONFIG_APPS 1 00:06:58.065 #define SPDK_CONFIG_ARCH native 00:06:58.065 #undef SPDK_CONFIG_ASAN 00:06:58.065 #undef SPDK_CONFIG_AVAHI 00:06:58.065 #undef SPDK_CONFIG_CET 00:06:58.065 #define SPDK_CONFIG_COVERAGE 1 00:06:58.065 #define SPDK_CONFIG_CROSS_PREFIX 00:06:58.065 #undef SPDK_CONFIG_CRYPTO 00:06:58.065 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:58.065 #undef SPDK_CONFIG_CUSTOMOCF 00:06:58.065 #undef SPDK_CONFIG_DAOS 00:06:58.065 #define SPDK_CONFIG_DAOS_DIR 00:06:58.065 #define SPDK_CONFIG_DEBUG 1 00:06:58.065 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:58.065 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:58.065 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:58.065 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:58.065 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:58.065 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:58.065 #define SPDK_CONFIG_EXAMPLES 1 00:06:58.065 #undef SPDK_CONFIG_FC 00:06:58.065 #define SPDK_CONFIG_FC_PATH 00:06:58.065 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:58.065 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:58.065 #undef SPDK_CONFIG_FUSE 00:06:58.065 #undef SPDK_CONFIG_FUZZER 00:06:58.065 #define SPDK_CONFIG_FUZZER_LIB 00:06:58.065 #undef SPDK_CONFIG_GOLANG 00:06:58.065 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:58.065 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:58.066 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:58.066 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:58.066 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:58.066 #define SPDK_CONFIG_IDXD 1 00:06:58.066 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:58.066 #undef SPDK_CONFIG_IPSEC_MB 00:06:58.066 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:58.066 #define SPDK_CONFIG_ISAL 1 00:06:58.066 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:58.066 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:58.066 #define SPDK_CONFIG_LIBDIR 00:06:58.066 #undef SPDK_CONFIG_LTO 00:06:58.066 #define SPDK_CONFIG_MAX_LCORES 00:06:58.066 #define SPDK_CONFIG_NVME_CUSE 1 00:06:58.066 #undef SPDK_CONFIG_OCF 00:06:58.066 #define SPDK_CONFIG_OCF_PATH 00:06:58.066 #define SPDK_CONFIG_OPENSSL_PATH 00:06:58.066 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:58.066 #undef SPDK_CONFIG_PGO_USE 00:06:58.066 #define SPDK_CONFIG_PREFIX /usr/local 00:06:58.066 #undef SPDK_CONFIG_RAID5F 00:06:58.066 #undef SPDK_CONFIG_RBD 00:06:58.066 #define SPDK_CONFIG_RDMA 1 00:06:58.066 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:58.066 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:58.066 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:58.066 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:58.066 #define SPDK_CONFIG_SHARED 1 00:06:58.066 #undef SPDK_CONFIG_SMA 00:06:58.066 #define SPDK_CONFIG_TESTS 1 00:06:58.066 #undef SPDK_CONFIG_TSAN 00:06:58.066 #define SPDK_CONFIG_UBLK 1 00:06:58.066 #define SPDK_CONFIG_UBSAN 1 00:06:58.066 #undef SPDK_CONFIG_UNIT_TESTS 00:06:58.066 #undef SPDK_CONFIG_URING 00:06:58.066 #define SPDK_CONFIG_URING_PATH 00:06:58.066 #undef SPDK_CONFIG_URING_ZNS 00:06:58.066 #undef SPDK_CONFIG_USDT 00:06:58.066 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:58.066 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:58.066 #undef SPDK_CONFIG_VFIO_USER 00:06:58.066 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:58.066 #define SPDK_CONFIG_VHOST 1 00:06:58.066 #define SPDK_CONFIG_VIRTIO 1 00:06:58.066 #undef SPDK_CONFIG_VTUNE 00:06:58.066 #define SPDK_CONFIG_VTUNE_DIR 00:06:58.066 #define SPDK_CONFIG_WERROR 1 00:06:58.066 #define SPDK_CONFIG_WPDK_DIR 00:06:58.066 #undef SPDK_CONFIG_XNVME 00:06:58.066 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:58.066 07:05:00 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:58.066 07:05:00 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:58.066 07:05:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:58.066 07:05:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:58.066 07:05:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:58.066 07:05:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.066 07:05:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.066 07:05:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.066 07:05:00 -- paths/export.sh@5 -- # export PATH 00:06:58.066 07:05:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.066 07:05:00 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:58.066 07:05:00 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:58.066 07:05:00 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:58.066 07:05:00 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:58.066 07:05:00 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:58.066 07:05:00 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:58.066 07:05:00 -- pm/common@16 -- # TEST_TAG=N/A 00:06:58.066 07:05:00 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:58.066 07:05:00 -- common/autotest_common.sh@52 -- # : 1 00:06:58.066 07:05:00 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:58.066 07:05:00 -- common/autotest_common.sh@56 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:58.066 07:05:00 -- common/autotest_common.sh@58 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:58.066 07:05:00 -- common/autotest_common.sh@60 -- # : 1 00:06:58.066 07:05:00 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:58.066 07:05:00 -- common/autotest_common.sh@62 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:58.066 07:05:00 -- common/autotest_common.sh@64 -- # : 00:06:58.066 07:05:00 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:58.066 07:05:00 -- common/autotest_common.sh@66 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:58.066 07:05:00 -- common/autotest_common.sh@68 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:58.066 07:05:00 -- common/autotest_common.sh@70 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:58.066 07:05:00 -- common/autotest_common.sh@72 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:58.066 07:05:00 -- common/autotest_common.sh@74 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:58.066 07:05:00 -- common/autotest_common.sh@76 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:58.066 07:05:00 -- common/autotest_common.sh@78 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:58.066 07:05:00 -- common/autotest_common.sh@80 -- # : 1 00:06:58.066 07:05:00 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:58.066 07:05:00 -- common/autotest_common.sh@82 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:58.066 07:05:00 -- common/autotest_common.sh@84 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:58.066 07:05:00 -- common/autotest_common.sh@86 -- # : 1 00:06:58.066 07:05:00 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:58.066 07:05:00 -- common/autotest_common.sh@88 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:58.066 07:05:00 -- common/autotest_common.sh@90 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:58.066 07:05:00 -- common/autotest_common.sh@92 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:58.066 07:05:00 -- common/autotest_common.sh@94 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:58.066 07:05:00 -- common/autotest_common.sh@96 -- # : tcp 00:06:58.066 07:05:00 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:58.066 07:05:00 -- common/autotest_common.sh@98 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:58.066 07:05:00 -- common/autotest_common.sh@100 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:58.066 07:05:00 -- common/autotest_common.sh@102 -- # : 0 00:06:58.066 07:05:00 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:58.067 07:05:00 -- common/autotest_common.sh@104 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:58.067 07:05:00 -- common/autotest_common.sh@106 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:58.067 07:05:00 -- common/autotest_common.sh@108 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:58.067 07:05:00 -- common/autotest_common.sh@110 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:58.067 07:05:00 -- common/autotest_common.sh@112 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:58.067 07:05:00 -- common/autotest_common.sh@114 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:58.067 07:05:00 -- common/autotest_common.sh@116 -- # : 1 00:06:58.067 07:05:00 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:58.067 07:05:00 -- common/autotest_common.sh@118 -- # : 00:06:58.067 07:05:00 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:58.067 07:05:00 -- common/autotest_common.sh@120 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:58.067 07:05:00 -- common/autotest_common.sh@122 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:58.067 07:05:00 -- common/autotest_common.sh@124 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:58.067 07:05:00 -- common/autotest_common.sh@126 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:58.067 07:05:00 -- common/autotest_common.sh@128 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:58.067 07:05:00 -- common/autotest_common.sh@130 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:58.067 07:05:00 -- common/autotest_common.sh@132 -- # : 00:06:58.067 07:05:00 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:58.067 07:05:00 -- common/autotest_common.sh@134 -- # : true 00:06:58.067 07:05:00 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:58.067 07:05:00 -- common/autotest_common.sh@136 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:58.067 07:05:00 -- common/autotest_common.sh@138 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:58.067 07:05:00 -- common/autotest_common.sh@140 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:58.067 07:05:00 -- common/autotest_common.sh@142 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:58.067 07:05:00 -- common/autotest_common.sh@144 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:58.067 07:05:00 -- common/autotest_common.sh@146 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:58.067 07:05:00 -- common/autotest_common.sh@148 -- # : e810 00:06:58.067 07:05:00 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:58.067 07:05:00 -- common/autotest_common.sh@150 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:58.067 07:05:00 -- common/autotest_common.sh@152 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:58.067 07:05:00 -- common/autotest_common.sh@154 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:58.067 07:05:00 -- common/autotest_common.sh@156 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:58.067 07:05:00 -- common/autotest_common.sh@158 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:58.067 07:05:00 -- common/autotest_common.sh@160 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:58.067 07:05:00 -- common/autotest_common.sh@163 -- # : 00:06:58.067 07:05:00 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:58.067 07:05:00 -- common/autotest_common.sh@165 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:58.067 07:05:00 -- common/autotest_common.sh@167 -- # : 0 00:06:58.067 07:05:00 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:58.067 07:05:00 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:58.067 07:05:00 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:58.067 07:05:00 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:58.067 07:05:00 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:58.067 07:05:00 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:58.067 07:05:00 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:58.067 07:05:00 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:58.067 07:05:00 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:58.067 07:05:00 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:58.067 07:05:00 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:58.067 07:05:00 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:58.067 07:05:00 -- common/autotest_common.sh@196 -- # cat 00:06:58.067 07:05:00 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:58.067 07:05:00 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:58.067 07:05:00 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:58.067 07:05:00 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:58.067 07:05:00 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:58.067 07:05:00 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:58.067 07:05:00 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:58.067 07:05:00 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.067 07:05:00 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:58.067 07:05:00 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.067 07:05:00 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:58.067 07:05:00 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:58.067 07:05:00 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:58.067 07:05:00 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:58.067 07:05:00 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:58.067 07:05:00 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:58.067 07:05:00 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:58.067 07:05:00 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:58.067 07:05:00 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:58.067 07:05:00 -- common/autotest_common.sh@249 -- # valgrind= 00:06:58.067 07:05:00 -- common/autotest_common.sh@255 -- # uname -s 00:06:58.067 07:05:00 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:58.067 07:05:00 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:58.067 07:05:00 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:58.067 07:05:00 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:58.068 07:05:00 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:06:58.068 07:05:00 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:58.068 07:05:00 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:58.068 07:05:00 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:58.068 07:05:00 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:58.068 07:05:00 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:58.068 07:05:00 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:58.068 07:05:00 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:58.068 07:05:00 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:58.068 07:05:00 -- common/autotest_common.sh@309 -- # [[ -z 1801996 ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@309 -- # kill -0 1801996 00:06:58.068 07:05:00 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:58.068 07:05:00 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:58.068 07:05:00 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:58.068 07:05:00 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:58.068 07:05:00 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:58.068 07:05:00 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:58.068 07:05:00 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:58.068 07:05:00 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.5joTka 00:06:58.068 07:05:00 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:58.068 07:05:00 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.5joTka/tests/target /tmp/spdk.5joTka 00:06:58.068 07:05:00 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@318 -- # df -T 00:06:58.068 07:05:00 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=4096 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=5284425728 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=55335383040 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61988524032 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=6653140992 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=30991667200 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994259968 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=2592768 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=12388913152 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12397707264 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=8794112 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=30993629184 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994264064 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=634880 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # avails["$mount"]=6198837248 00:06:58.068 07:05:00 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6198849536 00:06:58.068 07:05:00 -- common/autotest_common.sh@354 -- # uses["$mount"]=12288 00:06:58.068 07:05:00 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:58.068 07:05:00 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:58.068 * Looking for test storage... 00:06:58.068 07:05:00 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:58.068 07:05:00 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:58.068 07:05:00 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.068 07:05:00 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:58.068 07:05:00 -- common/autotest_common.sh@363 -- # mount=/ 00:06:58.068 07:05:00 -- common/autotest_common.sh@365 -- # target_space=55335383040 00:06:58.068 07:05:00 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:58.068 07:05:00 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:58.068 07:05:00 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@372 -- # new_size=8867733504 00:06:58.068 07:05:00 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:58.068 07:05:00 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.068 07:05:00 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.068 07:05:00 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:58.068 07:05:00 -- common/autotest_common.sh@380 -- # return 0 00:06:58.068 07:05:00 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:58.068 07:05:00 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:58.068 07:05:00 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:58.068 07:05:00 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:58.068 07:05:00 -- common/autotest_common.sh@1672 -- # true 00:06:58.068 07:05:00 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:58.068 07:05:00 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:58.068 07:05:00 -- common/autotest_common.sh@27 -- # exec 00:06:58.068 07:05:00 -- common/autotest_common.sh@29 -- # exec 00:06:58.068 07:05:00 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:58.068 07:05:00 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:58.068 07:05:00 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:58.068 07:05:00 -- common/autotest_common.sh@18 -- # set -x 00:06:58.068 07:05:00 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:58.068 07:05:00 -- nvmf/common.sh@7 -- # uname -s 00:06:58.068 07:05:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:58.068 07:05:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:58.068 07:05:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:58.068 07:05:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:58.068 07:05:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:58.068 07:05:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:58.068 07:05:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:58.068 07:05:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:58.068 07:05:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:58.068 07:05:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:58.068 07:05:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:58.068 07:05:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:58.068 07:05:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:58.068 07:05:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:58.068 07:05:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:58.068 07:05:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:58.068 07:05:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:58.068 07:05:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:58.068 07:05:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:58.068 07:05:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.068 07:05:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.069 07:05:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.069 07:05:00 -- paths/export.sh@5 -- # export PATH 00:06:58.069 07:05:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:58.069 07:05:00 -- nvmf/common.sh@46 -- # : 0 00:06:58.069 07:05:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:58.069 07:05:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:58.069 07:05:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:58.069 07:05:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:58.069 07:05:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:58.069 07:05:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:58.069 07:05:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:58.069 07:05:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:58.069 07:05:00 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:58.069 07:05:00 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:58.069 07:05:00 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:58.069 07:05:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:58.069 07:05:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:58.069 07:05:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:58.069 07:05:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:58.069 07:05:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:58.069 07:05:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:58.069 07:05:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:58.069 07:05:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:58.069 07:05:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:58.069 07:05:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:58.069 07:05:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:58.069 07:05:00 -- common/autotest_common.sh@10 -- # set +x 00:06:59.971 07:05:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:59.971 07:05:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:59.971 07:05:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:59.971 07:05:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:59.971 07:05:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:59.971 07:05:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:59.971 07:05:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:59.971 07:05:02 -- nvmf/common.sh@294 -- # net_devs=() 00:06:59.971 07:05:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:59.971 07:05:02 -- nvmf/common.sh@295 -- # e810=() 00:06:59.971 07:05:02 -- nvmf/common.sh@295 -- # local -ga e810 00:06:59.971 07:05:02 -- nvmf/common.sh@296 -- # x722=() 00:06:59.971 07:05:02 -- nvmf/common.sh@296 -- # local -ga x722 00:06:59.971 07:05:02 -- nvmf/common.sh@297 -- # mlx=() 00:06:59.971 07:05:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:59.971 07:05:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:59.971 07:05:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:59.971 07:05:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:59.971 07:05:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:59.971 07:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:59.971 07:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:59.971 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:59.971 07:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:59.971 07:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:00.230 07:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:00.230 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:00.230 07:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:00.230 07:05:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.230 07:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.230 07:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.230 07:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.230 07:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:00.230 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:00.230 07:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.230 07:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:00.230 07:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:00.230 07:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:00.230 07:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:00.230 07:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:00.230 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:00.230 07:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:00.230 07:05:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:00.230 07:05:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:00.230 07:05:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:00.230 07:05:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:00.230 07:05:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:00.230 07:05:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:00.230 07:05:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:00.230 07:05:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:00.230 07:05:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:00.230 07:05:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:00.230 07:05:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:00.230 07:05:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:00.230 07:05:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:00.230 07:05:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:00.230 07:05:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:00.230 07:05:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:00.230 07:05:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:00.230 07:05:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:00.230 07:05:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:00.230 07:05:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:00.230 07:05:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:00.230 07:05:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:00.230 07:05:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:00.230 07:05:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:00.230 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:00.230 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:07:00.230 00:07:00.230 --- 10.0.0.2 ping statistics --- 00:07:00.230 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.230 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:07:00.230 07:05:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:00.230 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:00.230 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:07:00.230 00:07:00.230 --- 10.0.0.1 ping statistics --- 00:07:00.230 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:00.230 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:07:00.230 07:05:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:00.230 07:05:03 -- nvmf/common.sh@410 -- # return 0 00:07:00.230 07:05:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:00.230 07:05:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:00.230 07:05:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:00.230 07:05:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:00.230 07:05:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:00.230 07:05:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:00.231 07:05:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:00.231 07:05:03 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:00.231 07:05:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:00.231 07:05:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:00.231 07:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.231 ************************************ 00:07:00.231 START TEST nvmf_filesystem_no_in_capsule 00:07:00.231 ************************************ 00:07:00.231 07:05:03 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:07:00.231 07:05:03 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:00.231 07:05:03 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:00.231 07:05:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:00.231 07:05:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:00.231 07:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.231 07:05:03 -- nvmf/common.sh@469 -- # nvmfpid=1803626 00:07:00.231 07:05:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:00.231 07:05:03 -- nvmf/common.sh@470 -- # waitforlisten 1803626 00:07:00.231 07:05:03 -- common/autotest_common.sh@819 -- # '[' -z 1803626 ']' 00:07:00.231 07:05:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.231 07:05:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:00.231 07:05:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.231 07:05:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:00.231 07:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.231 [2024-10-16 07:05:03.100231] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:00.231 [2024-10-16 07:05:03.100307] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:00.231 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.231 [2024-10-16 07:05:03.163925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:00.489 [2024-10-16 07:05:03.280328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:00.489 [2024-10-16 07:05:03.280478] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:00.489 [2024-10-16 07:05:03.280498] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:00.489 [2024-10-16 07:05:03.280511] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:00.489 [2024-10-16 07:05:03.280570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:00.489 [2024-10-16 07:05:03.280624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:00.489 [2024-10-16 07:05:03.280677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:00.489 [2024-10-16 07:05:03.280680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.423 07:05:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:01.423 07:05:04 -- common/autotest_common.sh@852 -- # return 0 00:07:01.423 07:05:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:01.423 07:05:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 07:05:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:01.423 07:05:04 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:01.423 07:05:04 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 [2024-10-16 07:05:04.107289] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 [2024-10-16 07:05:04.286831] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:01.423 07:05:04 -- common/autotest_common.sh@1359 -- # local bs 00:07:01.423 07:05:04 -- common/autotest_common.sh@1360 -- # local nb 00:07:01.423 07:05:04 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:01.423 07:05:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.423 07:05:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.423 07:05:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.423 07:05:04 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:01.423 { 00:07:01.423 "name": "Malloc1", 00:07:01.423 "aliases": [ 00:07:01.423 "81fe8fe7-f090-4b50-b6c8-1d7db5e7d3fc" 00:07:01.423 ], 00:07:01.423 "product_name": "Malloc disk", 00:07:01.423 "block_size": 512, 00:07:01.423 "num_blocks": 1048576, 00:07:01.423 "uuid": "81fe8fe7-f090-4b50-b6c8-1d7db5e7d3fc", 00:07:01.423 "assigned_rate_limits": { 00:07:01.423 "rw_ios_per_sec": 0, 00:07:01.423 "rw_mbytes_per_sec": 0, 00:07:01.423 "r_mbytes_per_sec": 0, 00:07:01.423 "w_mbytes_per_sec": 0 00:07:01.423 }, 00:07:01.423 "claimed": true, 00:07:01.423 "claim_type": "exclusive_write", 00:07:01.423 "zoned": false, 00:07:01.423 "supported_io_types": { 00:07:01.423 "read": true, 00:07:01.423 "write": true, 00:07:01.423 "unmap": true, 00:07:01.423 "write_zeroes": true, 00:07:01.423 "flush": true, 00:07:01.423 "reset": true, 00:07:01.423 "compare": false, 00:07:01.423 "compare_and_write": false, 00:07:01.423 "abort": true, 00:07:01.423 "nvme_admin": false, 00:07:01.423 "nvme_io": false 00:07:01.423 }, 00:07:01.423 "memory_domains": [ 00:07:01.423 { 00:07:01.423 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:01.423 "dma_device_type": 2 00:07:01.423 } 00:07:01.423 ], 00:07:01.423 "driver_specific": {} 00:07:01.423 } 00:07:01.423 ]' 00:07:01.423 07:05:04 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:01.423 07:05:04 -- common/autotest_common.sh@1362 -- # bs=512 00:07:01.423 07:05:04 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:01.681 07:05:04 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:01.681 07:05:04 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:01.681 07:05:04 -- common/autotest_common.sh@1367 -- # echo 512 00:07:01.681 07:05:04 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:01.681 07:05:04 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:02.246 07:05:04 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:02.246 07:05:04 -- common/autotest_common.sh@1177 -- # local i=0 00:07:02.246 07:05:04 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:02.246 07:05:04 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:02.246 07:05:04 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:04.143 07:05:06 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:04.143 07:05:06 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:04.143 07:05:06 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:04.143 07:05:07 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:04.143 07:05:07 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:04.143 07:05:07 -- common/autotest_common.sh@1187 -- # return 0 00:07:04.143 07:05:07 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:04.144 07:05:07 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:04.144 07:05:07 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:04.144 07:05:07 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:04.144 07:05:07 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:04.144 07:05:07 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:04.144 07:05:07 -- setup/common.sh@80 -- # echo 536870912 00:07:04.144 07:05:07 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:04.144 07:05:07 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:04.144 07:05:07 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:04.144 07:05:07 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:04.401 07:05:07 -- target/filesystem.sh@69 -- # partprobe 00:07:04.966 07:05:07 -- target/filesystem.sh@70 -- # sleep 1 00:07:05.899 07:05:08 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:05.899 07:05:08 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:05.899 07:05:08 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:05.899 07:05:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:05.899 07:05:08 -- common/autotest_common.sh@10 -- # set +x 00:07:05.899 ************************************ 00:07:05.899 START TEST filesystem_ext4 00:07:05.899 ************************************ 00:07:05.899 07:05:08 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:05.899 07:05:08 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:05.899 07:05:08 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.900 07:05:08 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:05.900 07:05:08 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:05.900 07:05:08 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:05.900 07:05:08 -- common/autotest_common.sh@904 -- # local i=0 00:07:05.900 07:05:08 -- common/autotest_common.sh@905 -- # local force 00:07:05.900 07:05:08 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:05.900 07:05:08 -- common/autotest_common.sh@908 -- # force=-F 00:07:05.900 07:05:08 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:05.900 mke2fs 1.47.0 (5-Feb-2023) 00:07:05.900 Discarding device blocks: 0/522240 done 00:07:05.900 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:05.900 Filesystem UUID: b4b9069d-5151-424d-b1ac-69ec23cad3bd 00:07:05.900 Superblock backups stored on blocks: 00:07:05.900 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:05.900 00:07:05.900 Allocating group tables: 0/64 done 00:07:05.900 Writing inode tables: 0/64 done 00:07:05.900 Creating journal (8192 blocks): done 00:07:06.157 Writing superblocks and filesystem accounting information: 0/64 done 00:07:06.157 00:07:06.157 07:05:08 -- common/autotest_common.sh@921 -- # return 0 00:07:06.157 07:05:08 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:12.751 07:05:14 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:12.751 07:05:15 -- target/filesystem.sh@25 -- # sync 00:07:12.751 07:05:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:12.751 07:05:15 -- target/filesystem.sh@27 -- # sync 00:07:12.751 07:05:15 -- target/filesystem.sh@29 -- # i=0 00:07:12.751 07:05:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:12.751 07:05:15 -- target/filesystem.sh@37 -- # kill -0 1803626 00:07:12.751 07:05:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:12.751 07:05:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:12.751 07:05:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:12.751 07:05:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:12.751 00:07:12.751 real 0m6.458s 00:07:12.751 user 0m0.015s 00:07:12.751 sys 0m0.066s 00:07:12.751 07:05:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:12.751 07:05:15 -- common/autotest_common.sh@10 -- # set +x 00:07:12.751 ************************************ 00:07:12.751 END TEST filesystem_ext4 00:07:12.751 ************************************ 00:07:12.751 07:05:15 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:12.751 07:05:15 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:12.751 07:05:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:12.751 07:05:15 -- common/autotest_common.sh@10 -- # set +x 00:07:12.751 ************************************ 00:07:12.751 START TEST filesystem_btrfs 00:07:12.751 ************************************ 00:07:12.751 07:05:15 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:12.751 07:05:15 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:12.751 07:05:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:12.751 07:05:15 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:12.751 07:05:15 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:12.751 07:05:15 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:12.751 07:05:15 -- common/autotest_common.sh@904 -- # local i=0 00:07:12.751 07:05:15 -- common/autotest_common.sh@905 -- # local force 00:07:12.751 07:05:15 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:12.751 07:05:15 -- common/autotest_common.sh@910 -- # force=-f 00:07:12.751 07:05:15 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:12.751 btrfs-progs v6.8.1 00:07:12.751 See https://btrfs.readthedocs.io for more information. 00:07:12.751 00:07:12.751 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:12.751 NOTE: several default settings have changed in version 5.15, please make sure 00:07:12.751 this does not affect your deployments: 00:07:12.751 - DUP for metadata (-m dup) 00:07:12.751 - enabled no-holes (-O no-holes) 00:07:12.751 - enabled free-space-tree (-R free-space-tree) 00:07:12.751 00:07:12.751 Label: (null) 00:07:12.751 UUID: b0387c1c-ed68-49a9-be6a-23ccca39497c 00:07:12.751 Node size: 16384 00:07:12.751 Sector size: 4096 (CPU page size: 4096) 00:07:12.751 Filesystem size: 510.00MiB 00:07:12.751 Block group profiles: 00:07:12.751 Data: single 8.00MiB 00:07:12.751 Metadata: DUP 32.00MiB 00:07:12.751 System: DUP 8.00MiB 00:07:12.751 SSD detected: yes 00:07:12.751 Zoned device: no 00:07:12.751 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:12.751 Checksum: crc32c 00:07:12.751 Number of devices: 1 00:07:12.751 Devices: 00:07:12.751 ID SIZE PATH 00:07:12.751 1 510.00MiB /dev/nvme0n1p1 00:07:12.751 00:07:12.751 07:05:15 -- common/autotest_common.sh@921 -- # return 0 00:07:12.751 07:05:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:13.033 07:05:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:13.033 07:05:15 -- target/filesystem.sh@25 -- # sync 00:07:13.033 07:05:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:13.033 07:05:15 -- target/filesystem.sh@27 -- # sync 00:07:13.033 07:05:15 -- target/filesystem.sh@29 -- # i=0 00:07:13.033 07:05:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:13.033 07:05:15 -- target/filesystem.sh@37 -- # kill -0 1803626 00:07:13.033 07:05:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:13.033 07:05:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:13.291 07:05:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:13.291 07:05:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:13.291 00:07:13.291 real 0m0.878s 00:07:13.291 user 0m0.012s 00:07:13.291 sys 0m0.109s 00:07:13.291 07:05:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:13.291 07:05:15 -- common/autotest_common.sh@10 -- # set +x 00:07:13.291 ************************************ 00:07:13.291 END TEST filesystem_btrfs 00:07:13.291 ************************************ 00:07:13.291 07:05:15 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:13.291 07:05:15 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:13.291 07:05:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:13.291 07:05:15 -- common/autotest_common.sh@10 -- # set +x 00:07:13.291 ************************************ 00:07:13.291 START TEST filesystem_xfs 00:07:13.291 ************************************ 00:07:13.291 07:05:16 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:13.291 07:05:16 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:13.291 07:05:16 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:13.291 07:05:16 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:13.291 07:05:16 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:13.291 07:05:16 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:13.291 07:05:16 -- common/autotest_common.sh@904 -- # local i=0 00:07:13.291 07:05:16 -- common/autotest_common.sh@905 -- # local force 00:07:13.291 07:05:16 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:13.291 07:05:16 -- common/autotest_common.sh@910 -- # force=-f 00:07:13.291 07:05:16 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:13.550 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:13.550 = sectsz=512 attr=2, projid32bit=1 00:07:13.550 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:13.550 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:13.550 data = bsize=4096 blocks=130560, imaxpct=25 00:07:13.550 = sunit=0 swidth=0 blks 00:07:13.550 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:13.550 log =internal log bsize=4096 blocks=16384, version=2 00:07:13.550 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:13.550 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:14.488 Discarding blocks...Done. 00:07:14.488 07:05:17 -- common/autotest_common.sh@921 -- # return 0 00:07:14.488 07:05:17 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.386 07:05:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.386 07:05:19 -- target/filesystem.sh@25 -- # sync 00:07:16.386 07:05:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.386 07:05:19 -- target/filesystem.sh@27 -- # sync 00:07:16.386 07:05:19 -- target/filesystem.sh@29 -- # i=0 00:07:16.386 07:05:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.386 07:05:19 -- target/filesystem.sh@37 -- # kill -0 1803626 00:07:16.386 07:05:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.386 07:05:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.386 07:05:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.386 07:05:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.386 00:07:16.386 real 0m3.212s 00:07:16.386 user 0m0.014s 00:07:16.386 sys 0m0.063s 00:07:16.386 07:05:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:16.386 07:05:19 -- common/autotest_common.sh@10 -- # set +x 00:07:16.386 ************************************ 00:07:16.386 END TEST filesystem_xfs 00:07:16.386 ************************************ 00:07:16.386 07:05:19 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:16.644 07:05:19 -- target/filesystem.sh@93 -- # sync 00:07:16.644 07:05:19 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:16.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:16.644 07:05:19 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:16.644 07:05:19 -- common/autotest_common.sh@1198 -- # local i=0 00:07:16.644 07:05:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:16.644 07:05:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:16.644 07:05:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:16.644 07:05:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:16.902 07:05:19 -- common/autotest_common.sh@1210 -- # return 0 00:07:16.903 07:05:19 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:16.903 07:05:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:16.903 07:05:19 -- common/autotest_common.sh@10 -- # set +x 00:07:16.903 07:05:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:16.903 07:05:19 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:16.903 07:05:19 -- target/filesystem.sh@101 -- # killprocess 1803626 00:07:16.903 07:05:19 -- common/autotest_common.sh@926 -- # '[' -z 1803626 ']' 00:07:16.903 07:05:19 -- common/autotest_common.sh@930 -- # kill -0 1803626 00:07:16.903 07:05:19 -- common/autotest_common.sh@931 -- # uname 00:07:16.903 07:05:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:16.903 07:05:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1803626 00:07:16.903 07:05:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:16.903 07:05:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:16.903 07:05:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1803626' 00:07:16.903 killing process with pid 1803626 00:07:16.903 07:05:19 -- common/autotest_common.sh@945 -- # kill 1803626 00:07:16.903 07:05:19 -- common/autotest_common.sh@950 -- # wait 1803626 00:07:17.469 07:05:20 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:17.469 00:07:17.469 real 0m17.057s 00:07:17.469 user 1m5.990s 00:07:17.469 sys 0m2.073s 00:07:17.469 07:05:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:17.469 07:05:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.469 ************************************ 00:07:17.469 END TEST nvmf_filesystem_no_in_capsule 00:07:17.469 ************************************ 00:07:17.469 07:05:20 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:17.469 07:05:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:17.469 07:05:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:17.469 07:05:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.469 ************************************ 00:07:17.469 START TEST nvmf_filesystem_in_capsule 00:07:17.469 ************************************ 00:07:17.469 07:05:20 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:07:17.469 07:05:20 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:17.469 07:05:20 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:17.469 07:05:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:17.469 07:05:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:17.469 07:05:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.469 07:05:20 -- nvmf/common.sh@469 -- # nvmfpid=1805915 00:07:17.469 07:05:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:17.469 07:05:20 -- nvmf/common.sh@470 -- # waitforlisten 1805915 00:07:17.469 07:05:20 -- common/autotest_common.sh@819 -- # '[' -z 1805915 ']' 00:07:17.469 07:05:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.469 07:05:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:17.469 07:05:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.469 07:05:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:17.469 07:05:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.469 [2024-10-16 07:05:20.184587] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:17.469 [2024-10-16 07:05:20.184661] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:17.469 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.469 [2024-10-16 07:05:20.254130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.469 [2024-10-16 07:05:20.377559] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:17.469 [2024-10-16 07:05:20.377734] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:17.469 [2024-10-16 07:05:20.377753] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:17.469 [2024-10-16 07:05:20.377767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:17.469 [2024-10-16 07:05:20.377824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.469 [2024-10-16 07:05:20.377856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.469 [2024-10-16 07:05:20.377908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.469 [2024-10-16 07:05:20.377911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.403 07:05:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:18.403 07:05:21 -- common/autotest_common.sh@852 -- # return 0 00:07:18.403 07:05:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:18.403 07:05:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:18.403 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.403 07:05:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:18.403 07:05:21 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:18.403 07:05:21 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:18.403 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.403 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.403 [2024-10-16 07:05:21.260605] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:18.403 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.403 07:05:21 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:18.403 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.403 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.661 Malloc1 00:07:18.661 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.661 07:05:21 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:18.661 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.661 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.661 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.661 07:05:21 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:18.661 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.661 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.661 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.661 07:05:21 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:18.661 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.661 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.661 [2024-10-16 07:05:21.446275] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:18.661 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.661 07:05:21 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:18.661 07:05:21 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:18.661 07:05:21 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:18.661 07:05:21 -- common/autotest_common.sh@1359 -- # local bs 00:07:18.661 07:05:21 -- common/autotest_common.sh@1360 -- # local nb 00:07:18.661 07:05:21 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:18.661 07:05:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.661 07:05:21 -- common/autotest_common.sh@10 -- # set +x 00:07:18.661 07:05:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.661 07:05:21 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:18.661 { 00:07:18.661 "name": "Malloc1", 00:07:18.661 "aliases": [ 00:07:18.661 "4766b0de-564e-4040-af84-eadaf073b24c" 00:07:18.661 ], 00:07:18.661 "product_name": "Malloc disk", 00:07:18.661 "block_size": 512, 00:07:18.661 "num_blocks": 1048576, 00:07:18.661 "uuid": "4766b0de-564e-4040-af84-eadaf073b24c", 00:07:18.661 "assigned_rate_limits": { 00:07:18.661 "rw_ios_per_sec": 0, 00:07:18.661 "rw_mbytes_per_sec": 0, 00:07:18.661 "r_mbytes_per_sec": 0, 00:07:18.661 "w_mbytes_per_sec": 0 00:07:18.661 }, 00:07:18.661 "claimed": true, 00:07:18.661 "claim_type": "exclusive_write", 00:07:18.661 "zoned": false, 00:07:18.661 "supported_io_types": { 00:07:18.661 "read": true, 00:07:18.661 "write": true, 00:07:18.661 "unmap": true, 00:07:18.661 "write_zeroes": true, 00:07:18.661 "flush": true, 00:07:18.661 "reset": true, 00:07:18.661 "compare": false, 00:07:18.661 "compare_and_write": false, 00:07:18.661 "abort": true, 00:07:18.661 "nvme_admin": false, 00:07:18.661 "nvme_io": false 00:07:18.661 }, 00:07:18.661 "memory_domains": [ 00:07:18.661 { 00:07:18.661 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:18.661 "dma_device_type": 2 00:07:18.661 } 00:07:18.661 ], 00:07:18.661 "driver_specific": {} 00:07:18.661 } 00:07:18.661 ]' 00:07:18.661 07:05:21 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:18.661 07:05:21 -- common/autotest_common.sh@1362 -- # bs=512 00:07:18.661 07:05:21 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:18.661 07:05:21 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:18.661 07:05:21 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:18.661 07:05:21 -- common/autotest_common.sh@1367 -- # echo 512 00:07:18.661 07:05:21 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:18.661 07:05:21 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:19.592 07:05:22 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:19.592 07:05:22 -- common/autotest_common.sh@1177 -- # local i=0 00:07:19.592 07:05:22 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:19.592 07:05:22 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:19.592 07:05:22 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:21.490 07:05:24 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:21.490 07:05:24 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:21.490 07:05:24 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:21.490 07:05:24 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:21.490 07:05:24 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:21.490 07:05:24 -- common/autotest_common.sh@1187 -- # return 0 00:07:21.490 07:05:24 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:21.490 07:05:24 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:21.490 07:05:24 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:21.490 07:05:24 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:21.490 07:05:24 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:21.490 07:05:24 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:21.490 07:05:24 -- setup/common.sh@80 -- # echo 536870912 00:07:21.490 07:05:24 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:21.490 07:05:24 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:21.490 07:05:24 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:21.490 07:05:24 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:21.747 07:05:24 -- target/filesystem.sh@69 -- # partprobe 00:07:22.681 07:05:25 -- target/filesystem.sh@70 -- # sleep 1 00:07:23.614 07:05:26 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:23.614 07:05:26 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:23.614 07:05:26 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:23.614 07:05:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:23.614 07:05:26 -- common/autotest_common.sh@10 -- # set +x 00:07:23.614 ************************************ 00:07:23.614 START TEST filesystem_in_capsule_ext4 00:07:23.614 ************************************ 00:07:23.614 07:05:26 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:23.614 07:05:26 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:23.614 07:05:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:23.614 07:05:26 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:23.614 07:05:26 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:23.614 07:05:26 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:23.614 07:05:26 -- common/autotest_common.sh@904 -- # local i=0 00:07:23.614 07:05:26 -- common/autotest_common.sh@905 -- # local force 00:07:23.614 07:05:26 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:23.614 07:05:26 -- common/autotest_common.sh@908 -- # force=-F 00:07:23.614 07:05:26 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:23.614 mke2fs 1.47.0 (5-Feb-2023) 00:07:23.872 Discarding device blocks: 0/522240 done 00:07:23.872 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:23.872 Filesystem UUID: 63df1ed7-d4de-4b69-9825-b1cbf480c7c3 00:07:23.872 Superblock backups stored on blocks: 00:07:23.872 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:23.872 00:07:23.872 Allocating group tables: 0/64 done 00:07:23.872 Writing inode tables: 0/64 done 00:07:23.872 Creating journal (8192 blocks): done 00:07:25.377 Writing superblocks and filesystem accounting information: 0/6450/64 done 00:07:25.377 00:07:25.377 07:05:28 -- common/autotest_common.sh@921 -- # return 0 00:07:25.377 07:05:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:31.931 07:05:33 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:31.931 07:05:33 -- target/filesystem.sh@25 -- # sync 00:07:31.931 07:05:33 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:31.931 07:05:33 -- target/filesystem.sh@27 -- # sync 00:07:31.931 07:05:33 -- target/filesystem.sh@29 -- # i=0 00:07:31.931 07:05:33 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:31.931 07:05:33 -- target/filesystem.sh@37 -- # kill -0 1805915 00:07:31.931 07:05:33 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:31.931 07:05:33 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:31.931 07:05:33 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:31.931 07:05:33 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:31.931 00:07:31.931 real 0m7.386s 00:07:31.931 user 0m0.018s 00:07:31.931 sys 0m0.056s 00:07:31.931 07:05:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:31.931 07:05:33 -- common/autotest_common.sh@10 -- # set +x 00:07:31.931 ************************************ 00:07:31.931 END TEST filesystem_in_capsule_ext4 00:07:31.931 ************************************ 00:07:31.931 07:05:33 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:31.931 07:05:33 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:31.931 07:05:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:31.931 07:05:33 -- common/autotest_common.sh@10 -- # set +x 00:07:31.931 ************************************ 00:07:31.931 START TEST filesystem_in_capsule_btrfs 00:07:31.931 ************************************ 00:07:31.931 07:05:33 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:31.931 07:05:33 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:31.931 07:05:33 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:31.931 07:05:33 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:31.931 07:05:33 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:31.931 07:05:33 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:31.931 07:05:33 -- common/autotest_common.sh@904 -- # local i=0 00:07:31.931 07:05:33 -- common/autotest_common.sh@905 -- # local force 00:07:31.931 07:05:33 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:31.931 07:05:33 -- common/autotest_common.sh@910 -- # force=-f 00:07:31.931 07:05:33 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:31.931 btrfs-progs v6.8.1 00:07:31.931 See https://btrfs.readthedocs.io for more information. 00:07:31.931 00:07:31.931 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:31.931 NOTE: several default settings have changed in version 5.15, please make sure 00:07:31.931 this does not affect your deployments: 00:07:31.931 - DUP for metadata (-m dup) 00:07:31.931 - enabled no-holes (-O no-holes) 00:07:31.931 - enabled free-space-tree (-R free-space-tree) 00:07:31.931 00:07:31.931 Label: (null) 00:07:31.931 UUID: 36860018-7557-40e6-bc12-f8caf7421120 00:07:31.931 Node size: 16384 00:07:31.931 Sector size: 4096 (CPU page size: 4096) 00:07:31.931 Filesystem size: 510.00MiB 00:07:31.931 Block group profiles: 00:07:31.931 Data: single 8.00MiB 00:07:31.932 Metadata: DUP 32.00MiB 00:07:31.932 System: DUP 8.00MiB 00:07:31.932 SSD detected: yes 00:07:31.932 Zoned device: no 00:07:31.932 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:31.932 Checksum: crc32c 00:07:31.932 Number of devices: 1 00:07:31.932 Devices: 00:07:31.932 ID SIZE PATH 00:07:31.932 1 510.00MiB /dev/nvme0n1p1 00:07:31.932 00:07:31.932 07:05:34 -- common/autotest_common.sh@921 -- # return 0 00:07:31.932 07:05:34 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:31.932 07:05:34 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:31.932 07:05:34 -- target/filesystem.sh@25 -- # sync 00:07:31.932 07:05:34 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:31.932 07:05:34 -- target/filesystem.sh@27 -- # sync 00:07:31.932 07:05:34 -- target/filesystem.sh@29 -- # i=0 00:07:31.932 07:05:34 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:31.932 07:05:34 -- target/filesystem.sh@37 -- # kill -0 1805915 00:07:31.932 07:05:34 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:31.932 07:05:34 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:31.932 07:05:34 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:31.932 07:05:34 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:31.932 00:07:31.932 real 0m0.851s 00:07:31.932 user 0m0.016s 00:07:31.932 sys 0m0.109s 00:07:31.932 07:05:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:31.932 07:05:34 -- common/autotest_common.sh@10 -- # set +x 00:07:31.932 ************************************ 00:07:31.932 END TEST filesystem_in_capsule_btrfs 00:07:31.932 ************************************ 00:07:31.932 07:05:34 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:31.932 07:05:34 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:31.932 07:05:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:31.932 07:05:34 -- common/autotest_common.sh@10 -- # set +x 00:07:31.932 ************************************ 00:07:31.932 START TEST filesystem_in_capsule_xfs 00:07:31.932 ************************************ 00:07:31.932 07:05:34 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:31.932 07:05:34 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:31.932 07:05:34 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:31.932 07:05:34 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:31.932 07:05:34 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:31.932 07:05:34 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:31.932 07:05:34 -- common/autotest_common.sh@904 -- # local i=0 00:07:31.932 07:05:34 -- common/autotest_common.sh@905 -- # local force 00:07:31.932 07:05:34 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:31.932 07:05:34 -- common/autotest_common.sh@910 -- # force=-f 00:07:31.932 07:05:34 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:31.932 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:31.932 = sectsz=512 attr=2, projid32bit=1 00:07:31.932 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:31.932 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:31.932 data = bsize=4096 blocks=130560, imaxpct=25 00:07:31.932 = sunit=0 swidth=0 blks 00:07:31.932 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:31.932 log =internal log bsize=4096 blocks=16384, version=2 00:07:31.932 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:31.932 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:32.864 Discarding blocks...Done. 00:07:32.864 07:05:35 -- common/autotest_common.sh@921 -- # return 0 00:07:32.864 07:05:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:34.761 07:05:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:34.761 07:05:37 -- target/filesystem.sh@25 -- # sync 00:07:34.761 07:05:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:34.761 07:05:37 -- target/filesystem.sh@27 -- # sync 00:07:34.761 07:05:37 -- target/filesystem.sh@29 -- # i=0 00:07:34.761 07:05:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:34.761 07:05:37 -- target/filesystem.sh@37 -- # kill -0 1805915 00:07:34.761 07:05:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:34.761 07:05:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:34.761 07:05:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:34.761 07:05:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:34.761 00:07:34.761 real 0m2.819s 00:07:34.761 user 0m0.014s 00:07:34.761 sys 0m0.059s 00:07:34.761 07:05:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:34.761 07:05:37 -- common/autotest_common.sh@10 -- # set +x 00:07:34.761 ************************************ 00:07:34.761 END TEST filesystem_in_capsule_xfs 00:07:34.761 ************************************ 00:07:34.761 07:05:37 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:34.761 07:05:37 -- target/filesystem.sh@93 -- # sync 00:07:34.761 07:05:37 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:35.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.019 07:05:37 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:35.019 07:05:37 -- common/autotest_common.sh@1198 -- # local i=0 00:07:35.019 07:05:37 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:35.019 07:05:37 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:35.019 07:05:37 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:35.019 07:05:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:35.019 07:05:37 -- common/autotest_common.sh@1210 -- # return 0 00:07:35.019 07:05:37 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:35.019 07:05:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:35.019 07:05:37 -- common/autotest_common.sh@10 -- # set +x 00:07:35.019 07:05:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:35.019 07:05:37 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:35.019 07:05:37 -- target/filesystem.sh@101 -- # killprocess 1805915 00:07:35.019 07:05:37 -- common/autotest_common.sh@926 -- # '[' -z 1805915 ']' 00:07:35.019 07:05:37 -- common/autotest_common.sh@930 -- # kill -0 1805915 00:07:35.019 07:05:37 -- common/autotest_common.sh@931 -- # uname 00:07:35.019 07:05:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:35.019 07:05:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1805915 00:07:35.019 07:05:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:35.019 07:05:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:35.019 07:05:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1805915' 00:07:35.019 killing process with pid 1805915 00:07:35.019 07:05:37 -- common/autotest_common.sh@945 -- # kill 1805915 00:07:35.019 07:05:37 -- common/autotest_common.sh@950 -- # wait 1805915 00:07:35.586 07:05:38 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:35.586 00:07:35.587 real 0m18.218s 00:07:35.587 user 1m10.511s 00:07:35.587 sys 0m2.213s 00:07:35.587 07:05:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:35.587 07:05:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.587 ************************************ 00:07:35.587 END TEST nvmf_filesystem_in_capsule 00:07:35.587 ************************************ 00:07:35.587 07:05:38 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:35.587 07:05:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:35.587 07:05:38 -- nvmf/common.sh@116 -- # sync 00:07:35.587 07:05:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:35.587 07:05:38 -- nvmf/common.sh@119 -- # set +e 00:07:35.587 07:05:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:35.587 07:05:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:35.587 rmmod nvme_tcp 00:07:35.587 rmmod nvme_fabrics 00:07:35.587 rmmod nvme_keyring 00:07:35.587 07:05:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:35.587 07:05:38 -- nvmf/common.sh@123 -- # set -e 00:07:35.587 07:05:38 -- nvmf/common.sh@124 -- # return 0 00:07:35.587 07:05:38 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:35.587 07:05:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:35.587 07:05:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:35.587 07:05:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:35.587 07:05:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:35.587 07:05:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:35.587 07:05:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:35.587 07:05:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:35.587 07:05:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.122 07:05:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:38.122 00:07:38.122 real 0m39.698s 00:07:38.122 user 2m17.353s 00:07:38.122 sys 0m5.862s 00:07:38.122 07:05:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:38.122 07:05:40 -- common/autotest_common.sh@10 -- # set +x 00:07:38.122 ************************************ 00:07:38.122 END TEST nvmf_filesystem 00:07:38.122 ************************************ 00:07:38.122 07:05:40 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:38.122 07:05:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:38.122 07:05:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:38.122 07:05:40 -- common/autotest_common.sh@10 -- # set +x 00:07:38.122 ************************************ 00:07:38.122 START TEST nvmf_discovery 00:07:38.122 ************************************ 00:07:38.122 07:05:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:38.122 * Looking for test storage... 00:07:38.122 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:38.122 07:05:40 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:38.122 07:05:40 -- nvmf/common.sh@7 -- # uname -s 00:07:38.122 07:05:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:38.122 07:05:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:38.122 07:05:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:38.122 07:05:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:38.122 07:05:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:38.122 07:05:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:38.122 07:05:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:38.122 07:05:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:38.122 07:05:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:38.122 07:05:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:38.122 07:05:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.122 07:05:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:38.122 07:05:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:38.122 07:05:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:38.122 07:05:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:38.122 07:05:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:38.122 07:05:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:38.122 07:05:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:38.122 07:05:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:38.122 07:05:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.122 07:05:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.122 07:05:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.122 07:05:40 -- paths/export.sh@5 -- # export PATH 00:07:38.122 07:05:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:38.122 07:05:40 -- nvmf/common.sh@46 -- # : 0 00:07:38.122 07:05:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:38.122 07:05:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:38.122 07:05:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:38.122 07:05:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:38.122 07:05:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:38.122 07:05:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:38.122 07:05:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:38.122 07:05:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:38.122 07:05:40 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:38.122 07:05:40 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:38.122 07:05:40 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:38.122 07:05:40 -- target/discovery.sh@15 -- # hash nvme 00:07:38.122 07:05:40 -- target/discovery.sh@20 -- # nvmftestinit 00:07:38.122 07:05:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:38.122 07:05:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:38.122 07:05:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:38.122 07:05:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:38.122 07:05:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:38.122 07:05:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.122 07:05:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.122 07:05:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:38.122 07:05:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:38.122 07:05:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:38.122 07:05:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:38.122 07:05:40 -- common/autotest_common.sh@10 -- # set +x 00:07:40.026 07:05:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:40.026 07:05:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:40.026 07:05:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:40.026 07:05:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:40.026 07:05:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:40.026 07:05:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:40.026 07:05:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:40.026 07:05:42 -- nvmf/common.sh@294 -- # net_devs=() 00:07:40.026 07:05:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:40.026 07:05:42 -- nvmf/common.sh@295 -- # e810=() 00:07:40.026 07:05:42 -- nvmf/common.sh@295 -- # local -ga e810 00:07:40.026 07:05:42 -- nvmf/common.sh@296 -- # x722=() 00:07:40.026 07:05:42 -- nvmf/common.sh@296 -- # local -ga x722 00:07:40.026 07:05:42 -- nvmf/common.sh@297 -- # mlx=() 00:07:40.026 07:05:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:40.026 07:05:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:40.026 07:05:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:40.026 07:05:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:40.026 07:05:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:40.026 07:05:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:40.026 07:05:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:40.026 07:05:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:40.026 07:05:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.026 07:05:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:40.026 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:40.026 07:05:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.026 07:05:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:40.027 07:05:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:40.027 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:40.027 07:05:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:40.027 07:05:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.027 07:05:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.027 07:05:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.027 07:05:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.027 07:05:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:40.027 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:40.027 07:05:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.027 07:05:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:40.027 07:05:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:40.027 07:05:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:40.027 07:05:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:40.027 07:05:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:40.027 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:40.027 07:05:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:40.027 07:05:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:40.027 07:05:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:40.027 07:05:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:40.027 07:05:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:40.027 07:05:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:40.027 07:05:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:40.027 07:05:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:40.027 07:05:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:40.027 07:05:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:40.027 07:05:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:40.027 07:05:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:40.027 07:05:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:40.027 07:05:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:40.027 07:05:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:40.027 07:05:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:40.027 07:05:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:40.027 07:05:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:40.027 07:05:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:40.027 07:05:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:40.027 07:05:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:40.027 07:05:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:40.027 07:05:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:40.027 07:05:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:40.027 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:40.027 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:07:40.027 00:07:40.027 --- 10.0.0.2 ping statistics --- 00:07:40.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.027 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:07:40.027 07:05:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:40.027 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:40.027 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:07:40.027 00:07:40.027 --- 10.0.0.1 ping statistics --- 00:07:40.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:40.027 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:07:40.027 07:05:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:40.027 07:05:42 -- nvmf/common.sh@410 -- # return 0 00:07:40.027 07:05:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:40.027 07:05:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:40.027 07:05:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:40.027 07:05:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:40.027 07:05:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:40.027 07:05:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:40.027 07:05:42 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:40.027 07:05:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:40.027 07:05:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:40.027 07:05:42 -- common/autotest_common.sh@10 -- # set +x 00:07:40.027 07:05:42 -- nvmf/common.sh@469 -- # nvmfpid=1810172 00:07:40.027 07:05:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:40.027 07:05:42 -- nvmf/common.sh@470 -- # waitforlisten 1810172 00:07:40.027 07:05:42 -- common/autotest_common.sh@819 -- # '[' -z 1810172 ']' 00:07:40.027 07:05:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:40.027 07:05:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:40.027 07:05:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:40.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:40.027 07:05:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:40.027 07:05:42 -- common/autotest_common.sh@10 -- # set +x 00:07:40.027 [2024-10-16 07:05:42.819792] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:40.027 [2024-10-16 07:05:42.819875] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:40.027 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.027 [2024-10-16 07:05:42.894908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.285 [2024-10-16 07:05:43.014063] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:40.285 [2024-10-16 07:05:43.014232] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:40.285 [2024-10-16 07:05:43.014251] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:40.286 [2024-10-16 07:05:43.014266] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:40.286 [2024-10-16 07:05:43.014328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.286 [2024-10-16 07:05:43.014393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.286 [2024-10-16 07:05:43.014446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.286 [2024-10-16 07:05:43.014449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.851 07:05:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:40.851 07:05:43 -- common/autotest_common.sh@852 -- # return 0 00:07:40.851 07:05:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:40.851 07:05:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:40.851 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:41.109 07:05:43 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 [2024-10-16 07:05:43.807207] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@26 -- # seq 1 4 00:07:41.109 07:05:43 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:41.109 07:05:43 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 Null1 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 [2024-10-16 07:05:43.847522] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:41.109 07:05:43 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 Null2 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:41.109 07:05:43 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 Null3 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:41.109 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.109 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.109 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.109 07:05:43 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:41.110 07:05:43 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 Null4 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:41.110 07:05:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.110 07:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:41.110 07:05:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.110 07:05:43 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:41.368 00:07:41.368 Discovery Log Number of Records 6, Generation counter 6 00:07:41.368 =====Discovery Log Entry 0====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: current discovery subsystem 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4420 00:07:41.368 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: explicit discovery connections, duplicate discovery information 00:07:41.368 sectype: none 00:07:41.368 =====Discovery Log Entry 1====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: nvme subsystem 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4420 00:07:41.368 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: none 00:07:41.368 sectype: none 00:07:41.368 =====Discovery Log Entry 2====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: nvme subsystem 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4420 00:07:41.368 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: none 00:07:41.368 sectype: none 00:07:41.368 =====Discovery Log Entry 3====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: nvme subsystem 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4420 00:07:41.368 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: none 00:07:41.368 sectype: none 00:07:41.368 =====Discovery Log Entry 4====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: nvme subsystem 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4420 00:07:41.368 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: none 00:07:41.368 sectype: none 00:07:41.368 =====Discovery Log Entry 5====== 00:07:41.368 trtype: tcp 00:07:41.368 adrfam: ipv4 00:07:41.368 subtype: discovery subsystem referral 00:07:41.368 treq: not required 00:07:41.368 portid: 0 00:07:41.368 trsvcid: 4430 00:07:41.368 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:41.368 traddr: 10.0.0.2 00:07:41.368 eflags: none 00:07:41.368 sectype: none 00:07:41.368 07:05:44 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:41.368 Perform nvmf subsystem discovery via RPC 00:07:41.368 07:05:44 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:41.368 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.368 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.368 [2024-10-16 07:05:44.196505] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:41.368 [ 00:07:41.368 { 00:07:41.368 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:41.368 "subtype": "Discovery", 00:07:41.368 "listen_addresses": [ 00:07:41.368 { 00:07:41.368 "transport": "TCP", 00:07:41.368 "trtype": "TCP", 00:07:41.368 "adrfam": "IPv4", 00:07:41.368 "traddr": "10.0.0.2", 00:07:41.368 "trsvcid": "4420" 00:07:41.368 } 00:07:41.368 ], 00:07:41.368 "allow_any_host": true, 00:07:41.368 "hosts": [] 00:07:41.368 }, 00:07:41.368 { 00:07:41.368 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:41.368 "subtype": "NVMe", 00:07:41.368 "listen_addresses": [ 00:07:41.368 { 00:07:41.368 "transport": "TCP", 00:07:41.368 "trtype": "TCP", 00:07:41.368 "adrfam": "IPv4", 00:07:41.368 "traddr": "10.0.0.2", 00:07:41.368 "trsvcid": "4420" 00:07:41.368 } 00:07:41.368 ], 00:07:41.368 "allow_any_host": true, 00:07:41.368 "hosts": [], 00:07:41.368 "serial_number": "SPDK00000000000001", 00:07:41.368 "model_number": "SPDK bdev Controller", 00:07:41.368 "max_namespaces": 32, 00:07:41.368 "min_cntlid": 1, 00:07:41.368 "max_cntlid": 65519, 00:07:41.368 "namespaces": [ 00:07:41.368 { 00:07:41.368 "nsid": 1, 00:07:41.368 "bdev_name": "Null1", 00:07:41.368 "name": "Null1", 00:07:41.368 "nguid": "7B57B705A0524FD7A6963DB91AD8631C", 00:07:41.368 "uuid": "7b57b705-a052-4fd7-a696-3db91ad8631c" 00:07:41.368 } 00:07:41.368 ] 00:07:41.368 }, 00:07:41.368 { 00:07:41.368 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:41.368 "subtype": "NVMe", 00:07:41.368 "listen_addresses": [ 00:07:41.368 { 00:07:41.368 "transport": "TCP", 00:07:41.368 "trtype": "TCP", 00:07:41.368 "adrfam": "IPv4", 00:07:41.368 "traddr": "10.0.0.2", 00:07:41.368 "trsvcid": "4420" 00:07:41.368 } 00:07:41.368 ], 00:07:41.368 "allow_any_host": true, 00:07:41.368 "hosts": [], 00:07:41.368 "serial_number": "SPDK00000000000002", 00:07:41.368 "model_number": "SPDK bdev Controller", 00:07:41.368 "max_namespaces": 32, 00:07:41.368 "min_cntlid": 1, 00:07:41.368 "max_cntlid": 65519, 00:07:41.368 "namespaces": [ 00:07:41.368 { 00:07:41.368 "nsid": 1, 00:07:41.368 "bdev_name": "Null2", 00:07:41.368 "name": "Null2", 00:07:41.368 "nguid": "6880D39B83A441ACA96FDEDE6ED8B99C", 00:07:41.368 "uuid": "6880d39b-83a4-41ac-a96f-dede6ed8b99c" 00:07:41.368 } 00:07:41.368 ] 00:07:41.368 }, 00:07:41.368 { 00:07:41.368 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:41.368 "subtype": "NVMe", 00:07:41.368 "listen_addresses": [ 00:07:41.368 { 00:07:41.368 "transport": "TCP", 00:07:41.368 "trtype": "TCP", 00:07:41.368 "adrfam": "IPv4", 00:07:41.368 "traddr": "10.0.0.2", 00:07:41.368 "trsvcid": "4420" 00:07:41.368 } 00:07:41.368 ], 00:07:41.368 "allow_any_host": true, 00:07:41.368 "hosts": [], 00:07:41.368 "serial_number": "SPDK00000000000003", 00:07:41.368 "model_number": "SPDK bdev Controller", 00:07:41.368 "max_namespaces": 32, 00:07:41.368 "min_cntlid": 1, 00:07:41.368 "max_cntlid": 65519, 00:07:41.368 "namespaces": [ 00:07:41.368 { 00:07:41.368 "nsid": 1, 00:07:41.368 "bdev_name": "Null3", 00:07:41.368 "name": "Null3", 00:07:41.368 "nguid": "63B699B0FE514210BDA5B3C51D0174F5", 00:07:41.368 "uuid": "63b699b0-fe51-4210-bda5-b3c51d0174f5" 00:07:41.368 } 00:07:41.368 ] 00:07:41.368 }, 00:07:41.368 { 00:07:41.368 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:41.368 "subtype": "NVMe", 00:07:41.368 "listen_addresses": [ 00:07:41.368 { 00:07:41.368 "transport": "TCP", 00:07:41.368 "trtype": "TCP", 00:07:41.368 "adrfam": "IPv4", 00:07:41.368 "traddr": "10.0.0.2", 00:07:41.368 "trsvcid": "4420" 00:07:41.368 } 00:07:41.368 ], 00:07:41.368 "allow_any_host": true, 00:07:41.368 "hosts": [], 00:07:41.368 "serial_number": "SPDK00000000000004", 00:07:41.368 "model_number": "SPDK bdev Controller", 00:07:41.368 "max_namespaces": 32, 00:07:41.368 "min_cntlid": 1, 00:07:41.368 "max_cntlid": 65519, 00:07:41.368 "namespaces": [ 00:07:41.368 { 00:07:41.368 "nsid": 1, 00:07:41.368 "bdev_name": "Null4", 00:07:41.368 "name": "Null4", 00:07:41.368 "nguid": "F164830AD01142269637E047BDE78AEC", 00:07:41.368 "uuid": "f164830a-d011-4226-9637-e047bde78aec" 00:07:41.368 } 00:07:41.368 ] 00:07:41.368 } 00:07:41.368 ] 00:07:41.368 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.368 07:05:44 -- target/discovery.sh@42 -- # seq 1 4 00:07:41.369 07:05:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:41.369 07:05:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:41.369 07:05:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:41.369 07:05:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:41.369 07:05:44 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.369 07:05:44 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:41.369 07:05:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:41.369 07:05:44 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:41.369 07:05:44 -- common/autotest_common.sh@10 -- # set +x 00:07:41.369 07:05:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:41.627 07:05:44 -- target/discovery.sh@49 -- # check_bdevs= 00:07:41.627 07:05:44 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:41.627 07:05:44 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:41.627 07:05:44 -- target/discovery.sh@57 -- # nvmftestfini 00:07:41.627 07:05:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:41.627 07:05:44 -- nvmf/common.sh@116 -- # sync 00:07:41.627 07:05:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:41.627 07:05:44 -- nvmf/common.sh@119 -- # set +e 00:07:41.627 07:05:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:41.627 07:05:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:41.627 rmmod nvme_tcp 00:07:41.627 rmmod nvme_fabrics 00:07:41.627 rmmod nvme_keyring 00:07:41.627 07:05:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:41.627 07:05:44 -- nvmf/common.sh@123 -- # set -e 00:07:41.627 07:05:44 -- nvmf/common.sh@124 -- # return 0 00:07:41.627 07:05:44 -- nvmf/common.sh@477 -- # '[' -n 1810172 ']' 00:07:41.627 07:05:44 -- nvmf/common.sh@478 -- # killprocess 1810172 00:07:41.627 07:05:44 -- common/autotest_common.sh@926 -- # '[' -z 1810172 ']' 00:07:41.627 07:05:44 -- common/autotest_common.sh@930 -- # kill -0 1810172 00:07:41.627 07:05:44 -- common/autotest_common.sh@931 -- # uname 00:07:41.627 07:05:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:41.627 07:05:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1810172 00:07:41.627 07:05:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:41.627 07:05:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:41.627 07:05:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1810172' 00:07:41.627 killing process with pid 1810172 00:07:41.627 07:05:44 -- common/autotest_common.sh@945 -- # kill 1810172 00:07:41.627 [2024-10-16 07:05:44.432649] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:41.627 07:05:44 -- common/autotest_common.sh@950 -- # wait 1810172 00:07:41.886 07:05:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:41.886 07:05:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:41.886 07:05:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:41.886 07:05:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:41.886 07:05:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:41.886 07:05:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.886 07:05:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.886 07:05:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.418 07:05:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:44.418 00:07:44.418 real 0m6.257s 00:07:44.418 user 0m7.657s 00:07:44.418 sys 0m1.900s 00:07:44.418 07:05:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:44.418 07:05:46 -- common/autotest_common.sh@10 -- # set +x 00:07:44.418 ************************************ 00:07:44.418 END TEST nvmf_discovery 00:07:44.418 ************************************ 00:07:44.418 07:05:46 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:44.418 07:05:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:44.418 07:05:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:44.418 07:05:46 -- common/autotest_common.sh@10 -- # set +x 00:07:44.418 ************************************ 00:07:44.418 START TEST nvmf_referrals 00:07:44.418 ************************************ 00:07:44.418 07:05:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:44.418 * Looking for test storage... 00:07:44.418 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.418 07:05:46 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:44.418 07:05:46 -- nvmf/common.sh@7 -- # uname -s 00:07:44.418 07:05:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:44.418 07:05:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:44.418 07:05:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:44.418 07:05:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:44.418 07:05:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:44.418 07:05:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:44.418 07:05:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:44.418 07:05:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:44.418 07:05:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:44.418 07:05:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:44.418 07:05:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.418 07:05:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:44.418 07:05:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:44.418 07:05:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:44.418 07:05:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:44.418 07:05:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:44.418 07:05:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:44.418 07:05:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:44.418 07:05:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:44.418 07:05:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.418 07:05:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.418 07:05:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.418 07:05:46 -- paths/export.sh@5 -- # export PATH 00:07:44.418 07:05:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.418 07:05:46 -- nvmf/common.sh@46 -- # : 0 00:07:44.418 07:05:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:44.418 07:05:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:44.418 07:05:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:44.418 07:05:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:44.418 07:05:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:44.418 07:05:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:44.418 07:05:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:44.418 07:05:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:44.418 07:05:46 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:44.418 07:05:46 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:44.418 07:05:46 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:44.418 07:05:46 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:44.418 07:05:46 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:44.418 07:05:46 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:44.418 07:05:46 -- target/referrals.sh@37 -- # nvmftestinit 00:07:44.418 07:05:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:44.418 07:05:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:44.418 07:05:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:44.418 07:05:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:44.418 07:05:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:44.418 07:05:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.418 07:05:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.418 07:05:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.418 07:05:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:44.418 07:05:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:44.418 07:05:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:44.418 07:05:46 -- common/autotest_common.sh@10 -- # set +x 00:07:46.320 07:05:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:46.320 07:05:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:46.320 07:05:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:46.320 07:05:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:46.320 07:05:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:46.320 07:05:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:46.320 07:05:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:46.320 07:05:48 -- nvmf/common.sh@294 -- # net_devs=() 00:07:46.320 07:05:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:46.320 07:05:48 -- nvmf/common.sh@295 -- # e810=() 00:07:46.320 07:05:48 -- nvmf/common.sh@295 -- # local -ga e810 00:07:46.320 07:05:48 -- nvmf/common.sh@296 -- # x722=() 00:07:46.320 07:05:48 -- nvmf/common.sh@296 -- # local -ga x722 00:07:46.320 07:05:48 -- nvmf/common.sh@297 -- # mlx=() 00:07:46.320 07:05:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:46.320 07:05:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:46.320 07:05:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:46.320 07:05:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:46.320 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:46.320 07:05:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:46.320 07:05:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:46.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:46.320 07:05:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:46.320 07:05:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:46.320 07:05:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:46.320 07:05:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:46.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:46.320 07:05:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:46.320 07:05:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:46.320 07:05:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:46.320 07:05:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:46.320 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:46.320 07:05:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:46.320 07:05:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:46.320 07:05:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:46.320 07:05:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:46.320 07:05:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:46.320 07:05:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:46.320 07:05:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:46.320 07:05:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:46.320 07:05:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:46.320 07:05:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:46.320 07:05:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:46.320 07:05:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:46.320 07:05:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:46.320 07:05:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:46.320 07:05:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:46.320 07:05:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:46.320 07:05:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:46.320 07:05:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:46.320 07:05:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:46.320 07:05:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:46.320 07:05:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:46.320 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:46.320 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:07:46.320 00:07:46.320 --- 10.0.0.2 ping statistics --- 00:07:46.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:46.320 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:07:46.320 07:05:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:46.320 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:46.320 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:07:46.320 00:07:46.320 --- 10.0.0.1 ping statistics --- 00:07:46.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:46.320 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:07:46.320 07:05:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:46.320 07:05:48 -- nvmf/common.sh@410 -- # return 0 00:07:46.320 07:05:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:46.320 07:05:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:46.320 07:05:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:46.320 07:05:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:46.320 07:05:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:46.320 07:05:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:46.320 07:05:48 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:46.320 07:05:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:46.320 07:05:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:46.320 07:05:48 -- common/autotest_common.sh@10 -- # set +x 00:07:46.320 07:05:48 -- nvmf/common.sh@469 -- # nvmfpid=1812382 00:07:46.320 07:05:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:46.320 07:05:48 -- nvmf/common.sh@470 -- # waitforlisten 1812382 00:07:46.320 07:05:48 -- common/autotest_common.sh@819 -- # '[' -z 1812382 ']' 00:07:46.321 07:05:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:46.321 07:05:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:46.321 07:05:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:46.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:46.321 07:05:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:46.321 07:05:48 -- common/autotest_common.sh@10 -- # set +x 00:07:46.321 [2024-10-16 07:05:49.040100] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:46.321 [2024-10-16 07:05:49.040188] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:46.321 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.321 [2024-10-16 07:05:49.120507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:46.321 [2024-10-16 07:05:49.246292] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:46.321 [2024-10-16 07:05:49.246454] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:46.321 [2024-10-16 07:05:49.246473] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:46.321 [2024-10-16 07:05:49.246497] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:46.321 [2024-10-16 07:05:49.246570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.321 [2024-10-16 07:05:49.246627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.321 [2024-10-16 07:05:49.246680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:46.321 [2024-10-16 07:05:49.246684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.255 07:05:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:47.255 07:05:50 -- common/autotest_common.sh@852 -- # return 0 00:07:47.255 07:05:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:47.255 07:05:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:47.255 07:05:50 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 [2024-10-16 07:05:50.085349] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 [2024-10-16 07:05:50.097574] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:47.255 07:05:50 -- target/referrals.sh@48 -- # jq length 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.255 07:05:50 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:47.255 07:05:50 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:47.255 07:05:50 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:47.255 07:05:50 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:47.255 07:05:50 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:47.255 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.255 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.255 07:05:50 -- target/referrals.sh@21 -- # sort 00:07:47.255 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:47.513 07:05:50 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:47.513 07:05:50 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:47.513 07:05:50 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:47.513 07:05:50 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.513 07:05:50 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:47.513 07:05:50 -- target/referrals.sh@26 -- # sort 00:07:47.513 07:05:50 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:47.513 07:05:50 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:47.513 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.513 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.513 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:47.513 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.513 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.513 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:47.513 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.513 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.513 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.513 07:05:50 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:47.513 07:05:50 -- target/referrals.sh@56 -- # jq length 00:07:47.513 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.513 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:47.771 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.771 07:05:50 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:47.771 07:05:50 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:47.771 07:05:50 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:47.771 07:05:50 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:47.771 07:05:50 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:47.771 07:05:50 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:47.771 07:05:50 -- target/referrals.sh@26 -- # sort 00:07:48.029 07:05:50 -- target/referrals.sh@26 -- # echo 00:07:48.029 07:05:50 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:48.029 07:05:50 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:48.029 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.029 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.029 07:05:50 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:48.029 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.029 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.029 07:05:50 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:48.029 07:05:50 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.029 07:05:50 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.029 07:05:50 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.029 07:05:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.029 07:05:50 -- target/referrals.sh@21 -- # sort 00:07:48.029 07:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 07:05:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.029 07:05:50 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:48.029 07:05:50 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:48.029 07:05:50 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:48.029 07:05:50 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.029 07:05:50 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.029 07:05:50 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.029 07:05:50 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.029 07:05:50 -- target/referrals.sh@26 -- # sort 00:07:48.029 07:05:50 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:48.029 07:05:50 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:48.029 07:05:50 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:48.029 07:05:50 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:48.029 07:05:50 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:48.029 07:05:50 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.029 07:05:50 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:48.287 07:05:51 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:48.287 07:05:51 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:48.287 07:05:51 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:48.287 07:05:51 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:48.287 07:05:51 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.287 07:05:51 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:48.545 07:05:51 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:48.545 07:05:51 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:48.545 07:05:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.545 07:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:48.545 07:05:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.545 07:05:51 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:48.545 07:05:51 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.545 07:05:51 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.545 07:05:51 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.545 07:05:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.545 07:05:51 -- target/referrals.sh@21 -- # sort 00:07:48.545 07:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:48.545 07:05:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.545 07:05:51 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:48.545 07:05:51 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:48.545 07:05:51 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:48.545 07:05:51 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.545 07:05:51 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.545 07:05:51 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.545 07:05:51 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.545 07:05:51 -- target/referrals.sh@26 -- # sort 00:07:48.803 07:05:51 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:48.803 07:05:51 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:48.803 07:05:51 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:48.803 07:05:51 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:48.803 07:05:51 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:48.803 07:05:51 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.803 07:05:51 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:48.803 07:05:51 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:48.803 07:05:51 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:48.803 07:05:51 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:48.803 07:05:51 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:48.803 07:05:51 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.803 07:05:51 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:49.061 07:05:51 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:49.061 07:05:51 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:49.061 07:05:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.061 07:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:49.061 07:05:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.061 07:05:51 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.061 07:05:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.061 07:05:51 -- target/referrals.sh@82 -- # jq length 00:07:49.061 07:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:49.061 07:05:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.061 07:05:51 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:49.061 07:05:51 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:49.061 07:05:51 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.061 07:05:51 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.061 07:05:51 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.061 07:05:51 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.061 07:05:51 -- target/referrals.sh@26 -- # sort 00:07:49.319 07:05:52 -- target/referrals.sh@26 -- # echo 00:07:49.319 07:05:52 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:49.319 07:05:52 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:49.319 07:05:52 -- target/referrals.sh@86 -- # nvmftestfini 00:07:49.319 07:05:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:49.319 07:05:52 -- nvmf/common.sh@116 -- # sync 00:07:49.319 07:05:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:49.319 07:05:52 -- nvmf/common.sh@119 -- # set +e 00:07:49.319 07:05:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:49.319 07:05:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:49.319 rmmod nvme_tcp 00:07:49.319 rmmod nvme_fabrics 00:07:49.319 rmmod nvme_keyring 00:07:49.319 07:05:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:49.319 07:05:52 -- nvmf/common.sh@123 -- # set -e 00:07:49.319 07:05:52 -- nvmf/common.sh@124 -- # return 0 00:07:49.319 07:05:52 -- nvmf/common.sh@477 -- # '[' -n 1812382 ']' 00:07:49.319 07:05:52 -- nvmf/common.sh@478 -- # killprocess 1812382 00:07:49.319 07:05:52 -- common/autotest_common.sh@926 -- # '[' -z 1812382 ']' 00:07:49.319 07:05:52 -- common/autotest_common.sh@930 -- # kill -0 1812382 00:07:49.319 07:05:52 -- common/autotest_common.sh@931 -- # uname 00:07:49.319 07:05:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:49.319 07:05:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1812382 00:07:49.319 07:05:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:49.319 07:05:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:49.319 07:05:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1812382' 00:07:49.319 killing process with pid 1812382 00:07:49.319 07:05:52 -- common/autotest_common.sh@945 -- # kill 1812382 00:07:49.319 07:05:52 -- common/autotest_common.sh@950 -- # wait 1812382 00:07:49.887 07:05:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:49.887 07:05:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:49.887 07:05:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:49.887 07:05:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:49.887 07:05:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:49.887 07:05:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.887 07:05:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.887 07:05:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:51.847 07:05:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:51.847 00:07:51.847 real 0m7.804s 00:07:51.847 user 0m14.684s 00:07:51.847 sys 0m2.193s 00:07:51.847 07:05:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:51.847 07:05:54 -- common/autotest_common.sh@10 -- # set +x 00:07:51.847 ************************************ 00:07:51.847 END TEST nvmf_referrals 00:07:51.847 ************************************ 00:07:51.847 07:05:54 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:51.847 07:05:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:51.847 07:05:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:51.847 07:05:54 -- common/autotest_common.sh@10 -- # set +x 00:07:51.847 ************************************ 00:07:51.847 START TEST nvmf_connect_disconnect 00:07:51.847 ************************************ 00:07:51.848 07:05:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:51.848 * Looking for test storage... 00:07:51.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:51.848 07:05:54 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.848 07:05:54 -- nvmf/common.sh@7 -- # uname -s 00:07:51.848 07:05:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.848 07:05:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.848 07:05:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.848 07:05:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.848 07:05:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.848 07:05:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.848 07:05:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.848 07:05:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.848 07:05:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.848 07:05:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.848 07:05:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.848 07:05:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.848 07:05:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.848 07:05:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.848 07:05:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.848 07:05:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:51.848 07:05:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.848 07:05:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.848 07:05:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.848 07:05:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.848 07:05:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.848 07:05:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.848 07:05:54 -- paths/export.sh@5 -- # export PATH 00:07:51.848 07:05:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.848 07:05:54 -- nvmf/common.sh@46 -- # : 0 00:07:51.848 07:05:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:51.848 07:05:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:51.848 07:05:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:51.848 07:05:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.848 07:05:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.848 07:05:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:51.848 07:05:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:51.848 07:05:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:51.848 07:05:54 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:51.848 07:05:54 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:51.848 07:05:54 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:51.848 07:05:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:51.848 07:05:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:51.848 07:05:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:51.848 07:05:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:51.848 07:05:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:51.848 07:05:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:51.848 07:05:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:51.848 07:05:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:51.848 07:05:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:51.848 07:05:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:51.848 07:05:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:51.848 07:05:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.380 07:05:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.380 07:05:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:54.380 07:05:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:54.380 07:05:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:54.380 07:05:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:54.380 07:05:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:54.380 07:05:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:54.380 07:05:56 -- nvmf/common.sh@294 -- # net_devs=() 00:07:54.380 07:05:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:54.380 07:05:56 -- nvmf/common.sh@295 -- # e810=() 00:07:54.380 07:05:56 -- nvmf/common.sh@295 -- # local -ga e810 00:07:54.380 07:05:56 -- nvmf/common.sh@296 -- # x722=() 00:07:54.380 07:05:56 -- nvmf/common.sh@296 -- # local -ga x722 00:07:54.380 07:05:56 -- nvmf/common.sh@297 -- # mlx=() 00:07:54.380 07:05:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:54.380 07:05:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.380 07:05:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:54.380 07:05:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:54.380 07:05:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.380 07:05:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:54.380 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:54.380 07:05:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.380 07:05:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:54.380 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:54.380 07:05:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.380 07:05:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.380 07:05:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.380 07:05:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:54.380 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:54.380 07:05:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.380 07:05:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.380 07:05:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.380 07:05:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.380 07:05:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:54.380 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:54.380 07:05:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.380 07:05:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:54.380 07:05:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:54.380 07:05:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:54.380 07:05:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:54.380 07:05:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:54.380 07:05:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:54.380 07:05:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:54.380 07:05:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:54.380 07:05:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:54.380 07:05:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:54.380 07:05:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:54.380 07:05:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:54.380 07:05:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:54.380 07:05:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:54.380 07:05:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:54.380 07:05:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:54.380 07:05:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:54.380 07:05:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:54.380 07:05:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:54.380 07:05:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:54.380 07:05:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:54.380 07:05:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:54.380 07:05:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:54.380 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:54.380 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:07:54.380 00:07:54.380 --- 10.0.0.2 ping statistics --- 00:07:54.380 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.380 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:07:54.380 07:05:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:54.380 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:54.380 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:07:54.380 00:07:54.381 --- 10.0.0.1 ping statistics --- 00:07:54.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.381 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:07:54.381 07:05:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:54.381 07:05:56 -- nvmf/common.sh@410 -- # return 0 00:07:54.381 07:05:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:54.381 07:05:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:54.381 07:05:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:54.381 07:05:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:54.381 07:05:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:54.381 07:05:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:54.381 07:05:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:54.381 07:05:56 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:54.381 07:05:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:54.381 07:05:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:54.381 07:05:56 -- common/autotest_common.sh@10 -- # set +x 00:07:54.381 07:05:56 -- nvmf/common.sh@469 -- # nvmfpid=1814836 00:07:54.381 07:05:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:54.381 07:05:56 -- nvmf/common.sh@470 -- # waitforlisten 1814836 00:07:54.381 07:05:56 -- common/autotest_common.sh@819 -- # '[' -z 1814836 ']' 00:07:54.381 07:05:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.381 07:05:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:54.381 07:05:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.381 07:05:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:54.381 07:05:56 -- common/autotest_common.sh@10 -- # set +x 00:07:54.381 [2024-10-16 07:05:57.034652] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:54.381 [2024-10-16 07:05:57.034722] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:54.381 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.381 [2024-10-16 07:05:57.106311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:54.381 [2024-10-16 07:05:57.232514] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:54.381 [2024-10-16 07:05:57.232685] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:54.381 [2024-10-16 07:05:57.232704] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:54.381 [2024-10-16 07:05:57.232718] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:54.381 [2024-10-16 07:05:57.232815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:54.381 [2024-10-16 07:05:57.232848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:54.381 [2024-10-16 07:05:57.232899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:54.381 [2024-10-16 07:05:57.232903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.312 07:05:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:55.312 07:05:58 -- common/autotest_common.sh@852 -- # return 0 00:07:55.312 07:05:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:55.312 07:05:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 07:05:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:55.312 07:05:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 [2024-10-16 07:05:58.081385] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:55.312 07:05:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:55.312 07:05:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 07:05:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:55.312 07:05:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 07:05:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:55.312 07:05:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 07:05:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:55.312 07:05:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:55.312 07:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:55.312 [2024-10-16 07:05:58.132285] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:55.312 07:05:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:55.312 07:05:58 -- target/connect_disconnect.sh@34 -- # set +x 00:07:57.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.361 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.214 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.266 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.688 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.103 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.032 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.982 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.510 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.407 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.854 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.810 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.606 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.658 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.610 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.561 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.995 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.522 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.574 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.588 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.020 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.443 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.310 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.210 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.123 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.158 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.124 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.081 07:09:49 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:47.081 07:09:49 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:47.081 07:09:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:47.081 07:09:49 -- nvmf/common.sh@116 -- # sync 00:11:47.081 07:09:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:47.081 07:09:49 -- nvmf/common.sh@119 -- # set +e 00:11:47.081 07:09:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:47.081 07:09:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:47.081 rmmod nvme_tcp 00:11:47.081 rmmod nvme_fabrics 00:11:47.081 rmmod nvme_keyring 00:11:47.081 07:09:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:47.081 07:09:49 -- nvmf/common.sh@123 -- # set -e 00:11:47.081 07:09:49 -- nvmf/common.sh@124 -- # return 0 00:11:47.081 07:09:49 -- nvmf/common.sh@477 -- # '[' -n 1814836 ']' 00:11:47.081 07:09:49 -- nvmf/common.sh@478 -- # killprocess 1814836 00:11:47.081 07:09:49 -- common/autotest_common.sh@926 -- # '[' -z 1814836 ']' 00:11:47.081 07:09:49 -- common/autotest_common.sh@930 -- # kill -0 1814836 00:11:47.081 07:09:49 -- common/autotest_common.sh@931 -- # uname 00:11:47.081 07:09:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:47.081 07:09:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1814836 00:11:47.081 07:09:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:47.081 07:09:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:47.081 07:09:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1814836' 00:11:47.081 killing process with pid 1814836 00:11:47.081 07:09:49 -- common/autotest_common.sh@945 -- # kill 1814836 00:11:47.081 07:09:49 -- common/autotest_common.sh@950 -- # wait 1814836 00:11:47.081 07:09:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:47.081 07:09:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:47.081 07:09:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:47.081 07:09:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:47.081 07:09:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:47.081 07:09:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:47.081 07:09:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:47.081 07:09:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.616 07:09:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:49.616 00:11:49.616 real 3m57.448s 00:11:49.616 user 15m6.196s 00:11:49.616 sys 0m33.897s 00:11:49.616 07:09:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:49.616 07:09:52 -- common/autotest_common.sh@10 -- # set +x 00:11:49.616 ************************************ 00:11:49.616 END TEST nvmf_connect_disconnect 00:11:49.616 ************************************ 00:11:49.616 07:09:52 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:49.616 07:09:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:49.616 07:09:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:49.616 07:09:52 -- common/autotest_common.sh@10 -- # set +x 00:11:49.616 ************************************ 00:11:49.616 START TEST nvmf_multitarget 00:11:49.616 ************************************ 00:11:49.616 07:09:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:49.616 * Looking for test storage... 00:11:49.616 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:49.616 07:09:52 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:49.616 07:09:52 -- nvmf/common.sh@7 -- # uname -s 00:11:49.616 07:09:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:49.616 07:09:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:49.616 07:09:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:49.616 07:09:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:49.616 07:09:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:49.616 07:09:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:49.616 07:09:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:49.616 07:09:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:49.616 07:09:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:49.616 07:09:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:49.616 07:09:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.616 07:09:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.616 07:09:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:49.616 07:09:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:49.616 07:09:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:49.616 07:09:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:49.616 07:09:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:49.616 07:09:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:49.616 07:09:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:49.616 07:09:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.616 07:09:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.616 07:09:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.616 07:09:52 -- paths/export.sh@5 -- # export PATH 00:11:49.616 07:09:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.616 07:09:52 -- nvmf/common.sh@46 -- # : 0 00:11:49.616 07:09:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:49.616 07:09:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:49.616 07:09:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:49.616 07:09:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:49.616 07:09:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:49.616 07:09:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:49.616 07:09:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:49.616 07:09:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:49.616 07:09:52 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:49.616 07:09:52 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:49.616 07:09:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:49.616 07:09:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:49.616 07:09:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:49.616 07:09:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:49.616 07:09:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:49.616 07:09:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.616 07:09:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.616 07:09:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.616 07:09:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:49.616 07:09:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:49.616 07:09:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:49.616 07:09:52 -- common/autotest_common.sh@10 -- # set +x 00:11:51.519 07:09:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:51.519 07:09:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:51.519 07:09:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:51.519 07:09:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:51.519 07:09:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:51.519 07:09:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:51.519 07:09:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:51.519 07:09:54 -- nvmf/common.sh@294 -- # net_devs=() 00:11:51.519 07:09:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:51.519 07:09:54 -- nvmf/common.sh@295 -- # e810=() 00:11:51.519 07:09:54 -- nvmf/common.sh@295 -- # local -ga e810 00:11:51.519 07:09:54 -- nvmf/common.sh@296 -- # x722=() 00:11:51.519 07:09:54 -- nvmf/common.sh@296 -- # local -ga x722 00:11:51.519 07:09:54 -- nvmf/common.sh@297 -- # mlx=() 00:11:51.519 07:09:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:51.519 07:09:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:51.519 07:09:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:51.519 07:09:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:51.519 07:09:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:51.519 07:09:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.519 07:09:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:51.519 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:51.519 07:09:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.519 07:09:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.520 07:09:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:51.520 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:51.520 07:09:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:51.520 07:09:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.520 07:09:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.520 07:09:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.520 07:09:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.520 07:09:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:51.520 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:51.520 07:09:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.520 07:09:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.520 07:09:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.520 07:09:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.520 07:09:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.520 07:09:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:51.520 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:51.520 07:09:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.520 07:09:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:51.520 07:09:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:51.520 07:09:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:51.520 07:09:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:51.520 07:09:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:51.520 07:09:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:51.520 07:09:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:51.520 07:09:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:51.520 07:09:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:51.520 07:09:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:51.520 07:09:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:51.520 07:09:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:51.520 07:09:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:51.520 07:09:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:51.520 07:09:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:51.520 07:09:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:51.520 07:09:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:51.520 07:09:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:51.520 07:09:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:51.520 07:09:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:51.520 07:09:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:51.520 07:09:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:51.520 07:09:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:51.520 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:51.520 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.366 ms 00:11:51.520 00:11:51.520 --- 10.0.0.2 ping statistics --- 00:11:51.520 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.520 rtt min/avg/max/mdev = 0.366/0.366/0.366/0.000 ms 00:11:51.520 07:09:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:51.520 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:51.520 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:11:51.520 00:11:51.520 --- 10.0.0.1 ping statistics --- 00:11:51.520 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.520 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:11:51.520 07:09:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:51.520 07:09:54 -- nvmf/common.sh@410 -- # return 0 00:11:51.520 07:09:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:51.520 07:09:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:51.520 07:09:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:51.520 07:09:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:51.520 07:09:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:51.520 07:09:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:51.520 07:09:54 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:51.520 07:09:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:51.520 07:09:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:51.520 07:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:51.520 07:09:54 -- nvmf/common.sh@469 -- # nvmfpid=1847426 00:11:51.520 07:09:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:51.520 07:09:54 -- nvmf/common.sh@470 -- # waitforlisten 1847426 00:11:51.520 07:09:54 -- common/autotest_common.sh@819 -- # '[' -z 1847426 ']' 00:11:51.520 07:09:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:51.520 07:09:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:51.520 07:09:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:51.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:51.520 07:09:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:51.520 07:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:51.520 [2024-10-16 07:09:54.402863] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:11:51.520 [2024-10-16 07:09:54.402955] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:51.520 EAL: No free 2048 kB hugepages reported on node 1 00:11:51.778 [2024-10-16 07:09:54.468629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:51.778 [2024-10-16 07:09:54.581624] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:51.778 [2024-10-16 07:09:54.581789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:51.778 [2024-10-16 07:09:54.581809] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:51.778 [2024-10-16 07:09:54.581822] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:51.778 [2024-10-16 07:09:54.581887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:51.778 [2024-10-16 07:09:54.581952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:51.778 [2024-10-16 07:09:54.582015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:51.778 [2024-10-16 07:09:54.582018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:52.712 07:09:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:52.712 07:09:55 -- common/autotest_common.sh@852 -- # return 0 00:11:52.712 07:09:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:52.712 07:09:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:52.712 07:09:55 -- common/autotest_common.sh@10 -- # set +x 00:11:52.712 07:09:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:52.712 07:09:55 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:52.712 07:09:55 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:52.712 07:09:55 -- target/multitarget.sh@21 -- # jq length 00:11:52.712 07:09:55 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:52.712 07:09:55 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:52.712 "nvmf_tgt_1" 00:11:52.712 07:09:55 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:52.970 "nvmf_tgt_2" 00:11:52.970 07:09:55 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:52.970 07:09:55 -- target/multitarget.sh@28 -- # jq length 00:11:52.970 07:09:55 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:52.970 07:09:55 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:53.227 true 00:11:53.227 07:09:55 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:53.227 true 00:11:53.227 07:09:56 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:53.227 07:09:56 -- target/multitarget.sh@35 -- # jq length 00:11:53.485 07:09:56 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:53.485 07:09:56 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:53.485 07:09:56 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:53.485 07:09:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:53.485 07:09:56 -- nvmf/common.sh@116 -- # sync 00:11:53.485 07:09:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:53.485 07:09:56 -- nvmf/common.sh@119 -- # set +e 00:11:53.485 07:09:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:53.485 07:09:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:53.485 rmmod nvme_tcp 00:11:53.485 rmmod nvme_fabrics 00:11:53.485 rmmod nvme_keyring 00:11:53.485 07:09:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:53.485 07:09:56 -- nvmf/common.sh@123 -- # set -e 00:11:53.485 07:09:56 -- nvmf/common.sh@124 -- # return 0 00:11:53.485 07:09:56 -- nvmf/common.sh@477 -- # '[' -n 1847426 ']' 00:11:53.485 07:09:56 -- nvmf/common.sh@478 -- # killprocess 1847426 00:11:53.485 07:09:56 -- common/autotest_common.sh@926 -- # '[' -z 1847426 ']' 00:11:53.485 07:09:56 -- common/autotest_common.sh@930 -- # kill -0 1847426 00:11:53.485 07:09:56 -- common/autotest_common.sh@931 -- # uname 00:11:53.485 07:09:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:53.485 07:09:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1847426 00:11:53.485 07:09:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:53.485 07:09:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:53.485 07:09:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1847426' 00:11:53.485 killing process with pid 1847426 00:11:53.485 07:09:56 -- common/autotest_common.sh@945 -- # kill 1847426 00:11:53.485 07:09:56 -- common/autotest_common.sh@950 -- # wait 1847426 00:11:53.744 07:09:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:53.744 07:09:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:53.744 07:09:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:53.744 07:09:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:53.744 07:09:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:53.744 07:09:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:53.744 07:09:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:53.744 07:09:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.278 07:09:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:56.278 00:11:56.278 real 0m6.537s 00:11:56.278 user 0m9.538s 00:11:56.278 sys 0m2.013s 00:11:56.278 07:09:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:56.278 07:09:58 -- common/autotest_common.sh@10 -- # set +x 00:11:56.278 ************************************ 00:11:56.278 END TEST nvmf_multitarget 00:11:56.278 ************************************ 00:11:56.279 07:09:58 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:56.279 07:09:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:56.279 07:09:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:56.279 07:09:58 -- common/autotest_common.sh@10 -- # set +x 00:11:56.279 ************************************ 00:11:56.279 START TEST nvmf_rpc 00:11:56.279 ************************************ 00:11:56.279 07:09:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:56.279 * Looking for test storage... 00:11:56.279 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:56.279 07:09:58 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:56.279 07:09:58 -- nvmf/common.sh@7 -- # uname -s 00:11:56.279 07:09:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.279 07:09:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.279 07:09:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.279 07:09:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.279 07:09:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.279 07:09:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.279 07:09:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.279 07:09:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.279 07:09:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.279 07:09:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.279 07:09:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.279 07:09:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:56.279 07:09:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.279 07:09:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.279 07:09:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:56.279 07:09:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:56.279 07:09:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.279 07:09:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.279 07:09:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.279 07:09:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.279 07:09:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.279 07:09:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.279 07:09:58 -- paths/export.sh@5 -- # export PATH 00:11:56.279 07:09:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.279 07:09:58 -- nvmf/common.sh@46 -- # : 0 00:11:56.279 07:09:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:56.279 07:09:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:56.279 07:09:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:56.279 07:09:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.279 07:09:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.279 07:09:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:56.279 07:09:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:56.279 07:09:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:56.279 07:09:58 -- target/rpc.sh@11 -- # loops=5 00:11:56.279 07:09:58 -- target/rpc.sh@23 -- # nvmftestinit 00:11:56.279 07:09:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:56.279 07:09:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.279 07:09:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:56.279 07:09:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:56.279 07:09:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:56.279 07:09:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.279 07:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:56.279 07:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.279 07:09:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:56.279 07:09:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:56.279 07:09:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:56.279 07:09:58 -- common/autotest_common.sh@10 -- # set +x 00:11:58.182 07:10:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:58.182 07:10:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:58.182 07:10:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:58.182 07:10:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:58.183 07:10:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:58.183 07:10:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:58.183 07:10:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:58.183 07:10:00 -- nvmf/common.sh@294 -- # net_devs=() 00:11:58.183 07:10:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:58.183 07:10:00 -- nvmf/common.sh@295 -- # e810=() 00:11:58.183 07:10:00 -- nvmf/common.sh@295 -- # local -ga e810 00:11:58.183 07:10:00 -- nvmf/common.sh@296 -- # x722=() 00:11:58.183 07:10:00 -- nvmf/common.sh@296 -- # local -ga x722 00:11:58.183 07:10:00 -- nvmf/common.sh@297 -- # mlx=() 00:11:58.183 07:10:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:58.183 07:10:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:58.183 07:10:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.183 07:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:58.183 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:58.183 07:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.183 07:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:58.183 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:58.183 07:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.183 07:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.183 07:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.183 07:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:58.183 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:58.183 07:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.183 07:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.183 07:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.183 07:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:58.183 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:58.183 07:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:58.183 07:10:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:58.183 07:10:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:58.183 07:10:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:58.183 07:10:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:58.183 07:10:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:58.183 07:10:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:58.183 07:10:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:58.183 07:10:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:58.183 07:10:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:58.183 07:10:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:58.183 07:10:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:58.183 07:10:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:58.183 07:10:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:58.183 07:10:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:58.183 07:10:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:58.183 07:10:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:58.183 07:10:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:58.183 07:10:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:58.183 07:10:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:58.183 07:10:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:58.183 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:58.183 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:11:58.183 00:11:58.183 --- 10.0.0.2 ping statistics --- 00:11:58.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.183 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:11:58.183 07:10:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:58.183 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:58.183 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:11:58.183 00:11:58.183 --- 10.0.0.1 ping statistics --- 00:11:58.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.183 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:11:58.183 07:10:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:58.183 07:10:00 -- nvmf/common.sh@410 -- # return 0 00:11:58.183 07:10:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:58.183 07:10:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:58.183 07:10:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:58.183 07:10:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:58.183 07:10:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:58.183 07:10:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:58.183 07:10:01 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:58.183 07:10:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:58.183 07:10:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:58.183 07:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.183 07:10:01 -- nvmf/common.sh@469 -- # nvmfpid=1849676 00:11:58.183 07:10:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:58.183 07:10:01 -- nvmf/common.sh@470 -- # waitforlisten 1849676 00:11:58.183 07:10:01 -- common/autotest_common.sh@819 -- # '[' -z 1849676 ']' 00:11:58.183 07:10:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:58.183 07:10:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:58.183 07:10:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:58.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:58.183 07:10:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:58.183 07:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:58.183 [2024-10-16 07:10:01.048576] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:11:58.183 [2024-10-16 07:10:01.048641] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:58.183 EAL: No free 2048 kB hugepages reported on node 1 00:11:58.183 [2024-10-16 07:10:01.118834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:58.442 [2024-10-16 07:10:01.238899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:58.442 [2024-10-16 07:10:01.239063] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:58.442 [2024-10-16 07:10:01.239084] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:58.442 [2024-10-16 07:10:01.239105] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:58.442 [2024-10-16 07:10:01.239191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:58.442 [2024-10-16 07:10:01.239236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:58.442 [2024-10-16 07:10:01.239288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:58.442 [2024-10-16 07:10:01.239291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:59.376 07:10:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:59.376 07:10:01 -- common/autotest_common.sh@852 -- # return 0 00:11:59.376 07:10:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:59.376 07:10:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:59.376 07:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:59.376 07:10:02 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@26 -- # stats='{ 00:11:59.376 "tick_rate": 2700000000, 00:11:59.376 "poll_groups": [ 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_0", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_1", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_2", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_3", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [] 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 }' 00:11:59.376 07:10:02 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:59.376 07:10:02 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:59.376 07:10:02 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:59.376 07:10:02 -- target/rpc.sh@15 -- # wc -l 00:11:59.376 07:10:02 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:59.376 07:10:02 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:59.376 07:10:02 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:59.376 07:10:02 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 [2024-10-16 07:10:02.113500] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@33 -- # stats='{ 00:11:59.376 "tick_rate": 2700000000, 00:11:59.376 "poll_groups": [ 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_0", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [ 00:11:59.376 { 00:11:59.376 "trtype": "TCP" 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_1", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [ 00:11:59.376 { 00:11:59.376 "trtype": "TCP" 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_2", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [ 00:11:59.376 { 00:11:59.376 "trtype": "TCP" 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 }, 00:11:59.376 { 00:11:59.376 "name": "nvmf_tgt_poll_group_3", 00:11:59.376 "admin_qpairs": 0, 00:11:59.376 "io_qpairs": 0, 00:11:59.376 "current_admin_qpairs": 0, 00:11:59.376 "current_io_qpairs": 0, 00:11:59.376 "pending_bdev_io": 0, 00:11:59.376 "completed_nvme_io": 0, 00:11:59.376 "transports": [ 00:11:59.376 { 00:11:59.376 "trtype": "TCP" 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 } 00:11:59.376 ] 00:11:59.376 }' 00:11:59.376 07:10:02 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:59.376 07:10:02 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:59.376 07:10:02 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:59.376 07:10:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:59.376 07:10:02 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:59.376 07:10:02 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:59.376 07:10:02 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:59.376 07:10:02 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:59.376 07:10:02 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 Malloc1 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.376 07:10:02 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:59.376 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.376 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.376 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.377 07:10:02 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:59.377 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.377 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.377 [2024-10-16 07:10:02.265061] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.377 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.377 07:10:02 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.377 07:10:02 -- common/autotest_common.sh@640 -- # local es=0 00:11:59.377 07:10:02 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.377 07:10:02 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:59.377 07:10:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:59.377 07:10:02 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:59.377 07:10:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:59.377 07:10:02 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:59.377 07:10:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:59.377 07:10:02 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:59.377 07:10:02 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:59.377 07:10:02 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:59.377 [2024-10-16 07:10:02.287496] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:59.377 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:59.377 could not add new controller: failed to write to nvme-fabrics device 00:11:59.377 07:10:02 -- common/autotest_common.sh@643 -- # es=1 00:11:59.377 07:10:02 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:59.377 07:10:02 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:59.377 07:10:02 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:59.377 07:10:02 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:59.377 07:10:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:59.377 07:10:02 -- common/autotest_common.sh@10 -- # set +x 00:11:59.634 07:10:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:59.634 07:10:02 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:00.201 07:10:03 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:00.201 07:10:03 -- common/autotest_common.sh@1177 -- # local i=0 00:12:00.201 07:10:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:00.201 07:10:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:00.201 07:10:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:02.098 07:10:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:02.098 07:10:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:02.098 07:10:05 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:02.098 07:10:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:02.098 07:10:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:02.098 07:10:05 -- common/autotest_common.sh@1187 -- # return 0 00:12:02.098 07:10:05 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:02.356 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.356 07:10:05 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:02.356 07:10:05 -- common/autotest_common.sh@1198 -- # local i=0 00:12:02.356 07:10:05 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:02.356 07:10:05 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.356 07:10:05 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:02.356 07:10:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.356 07:10:05 -- common/autotest_common.sh@1210 -- # return 0 00:12:02.356 07:10:05 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:02.356 07:10:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.356 07:10:05 -- common/autotest_common.sh@10 -- # set +x 00:12:02.356 07:10:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.356 07:10:05 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.356 07:10:05 -- common/autotest_common.sh@640 -- # local es=0 00:12:02.356 07:10:05 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.356 07:10:05 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:02.356 07:10:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:02.356 07:10:05 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:02.356 07:10:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:02.356 07:10:05 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:02.356 07:10:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:02.356 07:10:05 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:02.356 07:10:05 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:02.356 07:10:05 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.356 [2024-10-16 07:10:05.116513] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:02.356 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:02.356 could not add new controller: failed to write to nvme-fabrics device 00:12:02.356 07:10:05 -- common/autotest_common.sh@643 -- # es=1 00:12:02.356 07:10:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:02.356 07:10:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:02.356 07:10:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:02.356 07:10:05 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:02.356 07:10:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:02.356 07:10:05 -- common/autotest_common.sh@10 -- # set +x 00:12:02.356 07:10:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:02.356 07:10:05 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.976 07:10:05 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.976 07:10:05 -- common/autotest_common.sh@1177 -- # local i=0 00:12:02.976 07:10:05 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.976 07:10:05 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:02.976 07:10:05 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:05.504 07:10:07 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:05.504 07:10:07 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:05.504 07:10:07 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:05.504 07:10:07 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:05.504 07:10:07 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:05.504 07:10:07 -- common/autotest_common.sh@1187 -- # return 0 00:12:05.504 07:10:07 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:05.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.504 07:10:07 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:05.504 07:10:07 -- common/autotest_common.sh@1198 -- # local i=0 00:12:05.504 07:10:07 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:05.504 07:10:07 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.504 07:10:07 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:05.504 07:10:07 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.504 07:10:07 -- common/autotest_common.sh@1210 -- # return 0 00:12:05.504 07:10:07 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:05.504 07:10:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.504 07:10:07 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 07:10:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.504 07:10:07 -- target/rpc.sh@81 -- # seq 1 5 00:12:05.504 07:10:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:05.504 07:10:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:05.504 07:10:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.504 07:10:07 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 07:10:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.504 07:10:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:05.504 07:10:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.504 07:10:07 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 [2024-10-16 07:10:07.992254] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:05.504 07:10:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.504 07:10:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:05.504 07:10:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.504 07:10:07 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 07:10:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.504 07:10:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:05.504 07:10:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.504 07:10:08 -- common/autotest_common.sh@10 -- # set +x 00:12:05.504 07:10:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.504 07:10:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.762 07:10:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:05.762 07:10:08 -- common/autotest_common.sh@1177 -- # local i=0 00:12:05.763 07:10:08 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:05.763 07:10:08 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:05.763 07:10:08 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:08.291 07:10:10 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:08.291 07:10:10 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:08.291 07:10:10 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:08.291 07:10:10 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:08.291 07:10:10 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:08.291 07:10:10 -- common/autotest_common.sh@1187 -- # return 0 00:12:08.291 07:10:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:08.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.291 07:10:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:08.291 07:10:10 -- common/autotest_common.sh@1198 -- # local i=0 00:12:08.291 07:10:10 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:08.291 07:10:10 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.291 07:10:10 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:08.291 07:10:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.291 07:10:10 -- common/autotest_common.sh@1210 -- # return 0 00:12:08.291 07:10:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:08.291 07:10:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 [2024-10-16 07:10:10.864875] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.291 07:10:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:08.291 07:10:10 -- common/autotest_common.sh@10 -- # set +x 00:12:08.291 07:10:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:08.291 07:10:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.857 07:10:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.857 07:10:11 -- common/autotest_common.sh@1177 -- # local i=0 00:12:08.857 07:10:11 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.857 07:10:11 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:08.857 07:10:11 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:10.755 07:10:13 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:10.755 07:10:13 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:10.755 07:10:13 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.755 07:10:13 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:10.755 07:10:13 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.755 07:10:13 -- common/autotest_common.sh@1187 -- # return 0 00:12:10.755 07:10:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.755 07:10:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.755 07:10:13 -- common/autotest_common.sh@1198 -- # local i=0 00:12:10.755 07:10:13 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:10.756 07:10:13 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.756 07:10:13 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:10.756 07:10:13 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.756 07:10:13 -- common/autotest_common.sh@1210 -- # return 0 00:12:10.756 07:10:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:10.756 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.756 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:11.013 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:11.013 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:11.013 07:10:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:11.013 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:11.013 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:11.013 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:11.013 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 [2024-10-16 07:10:13.721291] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:11.013 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:11.013 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:11.013 07:10:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:11.013 07:10:13 -- common/autotest_common.sh@10 -- # set +x 00:12:11.013 07:10:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:11.013 07:10:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:11.579 07:10:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:11.579 07:10:14 -- common/autotest_common.sh@1177 -- # local i=0 00:12:11.579 07:10:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:11.579 07:10:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:11.579 07:10:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:14.108 07:10:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:14.108 07:10:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:14.108 07:10:16 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:14.108 07:10:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:14.108 07:10:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:14.108 07:10:16 -- common/autotest_common.sh@1187 -- # return 0 00:12:14.109 07:10:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:14.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.109 07:10:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:14.109 07:10:16 -- common/autotest_common.sh@1198 -- # local i=0 00:12:14.109 07:10:16 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:14.109 07:10:16 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.109 07:10:16 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:14.109 07:10:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.109 07:10:16 -- common/autotest_common.sh@1210 -- # return 0 00:12:14.109 07:10:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:14.109 07:10:16 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 [2024-10-16 07:10:16.577262] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:14.109 07:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.109 07:10:16 -- common/autotest_common.sh@10 -- # set +x 00:12:14.109 07:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.109 07:10:16 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.367 07:10:17 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:14.367 07:10:17 -- common/autotest_common.sh@1177 -- # local i=0 00:12:14.367 07:10:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:14.367 07:10:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:14.367 07:10:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:16.267 07:10:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:16.267 07:10:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:16.267 07:10:19 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:16.526 07:10:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:16.526 07:10:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:16.526 07:10:19 -- common/autotest_common.sh@1187 -- # return 0 00:12:16.526 07:10:19 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:16.526 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.526 07:10:19 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:16.526 07:10:19 -- common/autotest_common.sh@1198 -- # local i=0 00:12:16.527 07:10:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:16.527 07:10:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.527 07:10:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:16.527 07:10:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:16.527 07:10:19 -- common/autotest_common.sh@1210 -- # return 0 00:12:16.527 07:10:19 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:16.527 07:10:19 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 [2024-10-16 07:10:19.330860] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:16.527 07:10:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.527 07:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:16.527 07:10:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.527 07:10:19 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:17.096 07:10:20 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:17.096 07:10:20 -- common/autotest_common.sh@1177 -- # local i=0 00:12:17.096 07:10:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:17.096 07:10:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:17.096 07:10:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:19.631 07:10:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:19.631 07:10:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:19.631 07:10:22 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.631 07:10:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:19.631 07:10:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.631 07:10:22 -- common/autotest_common.sh@1187 -- # return 0 00:12:19.631 07:10:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.631 07:10:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.631 07:10:22 -- common/autotest_common.sh@1198 -- # local i=0 00:12:19.631 07:10:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:19.631 07:10:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.631 07:10:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:19.631 07:10:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.631 07:10:22 -- common/autotest_common.sh@1210 -- # return 0 00:12:19.631 07:10:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:19.631 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.631 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.631 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.631 07:10:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.631 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.631 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.631 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.631 07:10:22 -- target/rpc.sh@99 -- # seq 1 5 00:12:19.631 07:10:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.631 07:10:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.631 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.631 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.631 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.631 07:10:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.631 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.631 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 [2024-10-16 07:10:22.169253] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.632 07:10:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 [2024-10-16 07:10:22.217326] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.632 07:10:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 [2024-10-16 07:10:22.265491] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.632 07:10:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 [2024-10-16 07:10:22.313664] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:19.632 07:10:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 [2024-10-16 07:10:22.361864] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.632 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.632 07:10:22 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:19.632 07:10:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.632 07:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:19.633 07:10:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.633 07:10:22 -- target/rpc.sh@110 -- # stats='{ 00:12:19.633 "tick_rate": 2700000000, 00:12:19.633 "poll_groups": [ 00:12:19.633 { 00:12:19.633 "name": "nvmf_tgt_poll_group_0", 00:12:19.633 "admin_qpairs": 2, 00:12:19.633 "io_qpairs": 84, 00:12:19.633 "current_admin_qpairs": 0, 00:12:19.633 "current_io_qpairs": 0, 00:12:19.633 "pending_bdev_io": 0, 00:12:19.633 "completed_nvme_io": 183, 00:12:19.633 "transports": [ 00:12:19.633 { 00:12:19.633 "trtype": "TCP" 00:12:19.633 } 00:12:19.633 ] 00:12:19.633 }, 00:12:19.633 { 00:12:19.633 "name": "nvmf_tgt_poll_group_1", 00:12:19.633 "admin_qpairs": 2, 00:12:19.633 "io_qpairs": 84, 00:12:19.633 "current_admin_qpairs": 0, 00:12:19.633 "current_io_qpairs": 0, 00:12:19.633 "pending_bdev_io": 0, 00:12:19.633 "completed_nvme_io": 136, 00:12:19.633 "transports": [ 00:12:19.633 { 00:12:19.633 "trtype": "TCP" 00:12:19.633 } 00:12:19.633 ] 00:12:19.633 }, 00:12:19.633 { 00:12:19.633 "name": "nvmf_tgt_poll_group_2", 00:12:19.633 "admin_qpairs": 1, 00:12:19.633 "io_qpairs": 84, 00:12:19.633 "current_admin_qpairs": 0, 00:12:19.633 "current_io_qpairs": 0, 00:12:19.633 "pending_bdev_io": 0, 00:12:19.633 "completed_nvme_io": 184, 00:12:19.633 "transports": [ 00:12:19.633 { 00:12:19.633 "trtype": "TCP" 00:12:19.633 } 00:12:19.633 ] 00:12:19.633 }, 00:12:19.633 { 00:12:19.633 "name": "nvmf_tgt_poll_group_3", 00:12:19.633 "admin_qpairs": 2, 00:12:19.633 "io_qpairs": 84, 00:12:19.633 "current_admin_qpairs": 0, 00:12:19.633 "current_io_qpairs": 0, 00:12:19.633 "pending_bdev_io": 0, 00:12:19.633 "completed_nvme_io": 183, 00:12:19.633 "transports": [ 00:12:19.633 { 00:12:19.633 "trtype": "TCP" 00:12:19.633 } 00:12:19.633 ] 00:12:19.633 } 00:12:19.633 ] 00:12:19.633 }' 00:12:19.633 07:10:22 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.633 07:10:22 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:19.633 07:10:22 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:19.633 07:10:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.633 07:10:22 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:19.633 07:10:22 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:19.633 07:10:22 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:19.633 07:10:22 -- target/rpc.sh@123 -- # nvmftestfini 00:12:19.633 07:10:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:19.633 07:10:22 -- nvmf/common.sh@116 -- # sync 00:12:19.633 07:10:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:19.633 07:10:22 -- nvmf/common.sh@119 -- # set +e 00:12:19.633 07:10:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:19.633 07:10:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:19.633 rmmod nvme_tcp 00:12:19.633 rmmod nvme_fabrics 00:12:19.633 rmmod nvme_keyring 00:12:19.633 07:10:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:19.633 07:10:22 -- nvmf/common.sh@123 -- # set -e 00:12:19.633 07:10:22 -- nvmf/common.sh@124 -- # return 0 00:12:19.633 07:10:22 -- nvmf/common.sh@477 -- # '[' -n 1849676 ']' 00:12:19.633 07:10:22 -- nvmf/common.sh@478 -- # killprocess 1849676 00:12:19.633 07:10:22 -- common/autotest_common.sh@926 -- # '[' -z 1849676 ']' 00:12:19.633 07:10:22 -- common/autotest_common.sh@930 -- # kill -0 1849676 00:12:19.633 07:10:22 -- common/autotest_common.sh@931 -- # uname 00:12:19.892 07:10:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:19.892 07:10:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1849676 00:12:19.892 07:10:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:19.892 07:10:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:19.892 07:10:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1849676' 00:12:19.892 killing process with pid 1849676 00:12:19.892 07:10:22 -- common/autotest_common.sh@945 -- # kill 1849676 00:12:19.892 07:10:22 -- common/autotest_common.sh@950 -- # wait 1849676 00:12:20.149 07:10:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:20.149 07:10:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:20.149 07:10:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:20.149 07:10:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:20.149 07:10:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:20.149 07:10:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:20.149 07:10:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:20.149 07:10:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.057 07:10:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:22.057 00:12:22.057 real 0m26.288s 00:12:22.057 user 1m25.939s 00:12:22.057 sys 0m4.241s 00:12:22.057 07:10:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:22.057 07:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:22.057 ************************************ 00:12:22.057 END TEST nvmf_rpc 00:12:22.057 ************************************ 00:12:22.057 07:10:24 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:22.057 07:10:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:22.057 07:10:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:22.057 07:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:22.057 ************************************ 00:12:22.057 START TEST nvmf_invalid 00:12:22.057 ************************************ 00:12:22.057 07:10:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:22.316 * Looking for test storage... 00:12:22.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:22.316 07:10:25 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:22.316 07:10:25 -- nvmf/common.sh@7 -- # uname -s 00:12:22.316 07:10:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:22.316 07:10:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:22.316 07:10:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:22.316 07:10:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:22.316 07:10:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:22.316 07:10:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:22.316 07:10:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:22.316 07:10:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:22.316 07:10:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:22.316 07:10:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:22.316 07:10:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.316 07:10:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.316 07:10:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:22.316 07:10:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:22.316 07:10:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:22.316 07:10:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:22.316 07:10:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:22.316 07:10:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:22.316 07:10:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:22.316 07:10:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.316 07:10:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.316 07:10:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.316 07:10:25 -- paths/export.sh@5 -- # export PATH 00:12:22.316 07:10:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.316 07:10:25 -- nvmf/common.sh@46 -- # : 0 00:12:22.316 07:10:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:22.316 07:10:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:22.316 07:10:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:22.316 07:10:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:22.316 07:10:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:22.316 07:10:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:22.316 07:10:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:22.316 07:10:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:22.316 07:10:25 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:22.316 07:10:25 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:22.316 07:10:25 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:22.316 07:10:25 -- target/invalid.sh@14 -- # target=foobar 00:12:22.316 07:10:25 -- target/invalid.sh@16 -- # RANDOM=0 00:12:22.316 07:10:25 -- target/invalid.sh@34 -- # nvmftestinit 00:12:22.316 07:10:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:22.316 07:10:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:22.316 07:10:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:22.316 07:10:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:22.316 07:10:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:22.316 07:10:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.316 07:10:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.316 07:10:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.316 07:10:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:22.316 07:10:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:22.316 07:10:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:22.316 07:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:24.855 07:10:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:24.855 07:10:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:24.855 07:10:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:24.855 07:10:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:24.855 07:10:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:24.855 07:10:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:24.855 07:10:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:24.855 07:10:27 -- nvmf/common.sh@294 -- # net_devs=() 00:12:24.855 07:10:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:24.855 07:10:27 -- nvmf/common.sh@295 -- # e810=() 00:12:24.855 07:10:27 -- nvmf/common.sh@295 -- # local -ga e810 00:12:24.855 07:10:27 -- nvmf/common.sh@296 -- # x722=() 00:12:24.855 07:10:27 -- nvmf/common.sh@296 -- # local -ga x722 00:12:24.855 07:10:27 -- nvmf/common.sh@297 -- # mlx=() 00:12:24.855 07:10:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:24.855 07:10:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.855 07:10:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.855 07:10:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.856 07:10:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.856 07:10:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:24.856 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:24.856 07:10:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.856 07:10:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:24.856 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:24.856 07:10:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.856 07:10:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.856 07:10:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.856 07:10:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:24.856 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:24.856 07:10:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.856 07:10:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.856 07:10:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.856 07:10:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:24.856 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:24.856 07:10:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:24.856 07:10:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:24.856 07:10:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:24.856 07:10:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:24.856 07:10:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:24.856 07:10:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:24.856 07:10:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:24.856 07:10:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:24.856 07:10:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:24.856 07:10:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:24.856 07:10:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:24.856 07:10:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:24.856 07:10:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:24.856 07:10:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:24.856 07:10:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:24.856 07:10:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:24.856 07:10:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:24.856 07:10:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:24.856 07:10:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:24.856 07:10:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:24.856 07:10:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:24.856 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:24.856 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.330 ms 00:12:24.856 00:12:24.856 --- 10.0.0.2 ping statistics --- 00:12:24.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.856 rtt min/avg/max/mdev = 0.330/0.330/0.330/0.000 ms 00:12:24.856 07:10:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:24.856 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:24.856 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:12:24.856 00:12:24.856 --- 10.0.0.1 ping statistics --- 00:12:24.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.856 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:12:24.856 07:10:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:24.856 07:10:27 -- nvmf/common.sh@410 -- # return 0 00:12:24.856 07:10:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:24.856 07:10:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:24.856 07:10:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:24.856 07:10:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:24.856 07:10:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:24.856 07:10:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:24.856 07:10:27 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:24.856 07:10:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:24.856 07:10:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:24.856 07:10:27 -- common/autotest_common.sh@10 -- # set +x 00:12:24.856 07:10:27 -- nvmf/common.sh@469 -- # nvmfpid=1854391 00:12:24.856 07:10:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:24.856 07:10:27 -- nvmf/common.sh@470 -- # waitforlisten 1854391 00:12:24.856 07:10:27 -- common/autotest_common.sh@819 -- # '[' -z 1854391 ']' 00:12:24.856 07:10:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.856 07:10:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:24.856 07:10:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.856 07:10:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:24.856 07:10:27 -- common/autotest_common.sh@10 -- # set +x 00:12:24.856 [2024-10-16 07:10:27.414812] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:12:24.856 [2024-10-16 07:10:27.414895] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.856 EAL: No free 2048 kB hugepages reported on node 1 00:12:24.856 [2024-10-16 07:10:27.481890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:24.856 [2024-10-16 07:10:27.599174] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:24.856 [2024-10-16 07:10:27.599343] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.856 [2024-10-16 07:10:27.599362] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.856 [2024-10-16 07:10:27.599377] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.856 [2024-10-16 07:10:27.599481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:24.856 [2024-10-16 07:10:27.599535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:24.856 [2024-10-16 07:10:27.599589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:24.856 [2024-10-16 07:10:27.599592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:25.791 07:10:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:25.791 07:10:28 -- common/autotest_common.sh@852 -- # return 0 00:12:25.791 07:10:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:25.791 07:10:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:25.791 07:10:28 -- common/autotest_common.sh@10 -- # set +x 00:12:25.791 07:10:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:25.791 07:10:28 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:25.791 07:10:28 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode26952 00:12:25.791 [2024-10-16 07:10:28.633955] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:25.791 07:10:28 -- target/invalid.sh@40 -- # out='request: 00:12:25.791 { 00:12:25.791 "nqn": "nqn.2016-06.io.spdk:cnode26952", 00:12:25.791 "tgt_name": "foobar", 00:12:25.791 "method": "nvmf_create_subsystem", 00:12:25.791 "req_id": 1 00:12:25.791 } 00:12:25.791 Got JSON-RPC error response 00:12:25.791 response: 00:12:25.791 { 00:12:25.791 "code": -32603, 00:12:25.791 "message": "Unable to find target foobar" 00:12:25.791 }' 00:12:25.791 07:10:28 -- target/invalid.sh@41 -- # [[ request: 00:12:25.791 { 00:12:25.791 "nqn": "nqn.2016-06.io.spdk:cnode26952", 00:12:25.791 "tgt_name": "foobar", 00:12:25.791 "method": "nvmf_create_subsystem", 00:12:25.791 "req_id": 1 00:12:25.791 } 00:12:25.791 Got JSON-RPC error response 00:12:25.791 response: 00:12:25.791 { 00:12:25.791 "code": -32603, 00:12:25.791 "message": "Unable to find target foobar" 00:12:25.791 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:25.791 07:10:28 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:25.791 07:10:28 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode27221 00:12:26.048 [2024-10-16 07:10:28.878788] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27221: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:26.048 07:10:28 -- target/invalid.sh@45 -- # out='request: 00:12:26.048 { 00:12:26.048 "nqn": "nqn.2016-06.io.spdk:cnode27221", 00:12:26.048 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:26.048 "method": "nvmf_create_subsystem", 00:12:26.048 "req_id": 1 00:12:26.048 } 00:12:26.048 Got JSON-RPC error response 00:12:26.048 response: 00:12:26.048 { 00:12:26.048 "code": -32602, 00:12:26.048 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:26.048 }' 00:12:26.048 07:10:28 -- target/invalid.sh@46 -- # [[ request: 00:12:26.048 { 00:12:26.048 "nqn": "nqn.2016-06.io.spdk:cnode27221", 00:12:26.048 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:26.048 "method": "nvmf_create_subsystem", 00:12:26.048 "req_id": 1 00:12:26.048 } 00:12:26.048 Got JSON-RPC error response 00:12:26.048 response: 00:12:26.048 { 00:12:26.048 "code": -32602, 00:12:26.048 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:26.048 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:26.048 07:10:28 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:26.048 07:10:28 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode23093 00:12:26.306 [2024-10-16 07:10:29.127599] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23093: invalid model number 'SPDK_Controller' 00:12:26.306 07:10:29 -- target/invalid.sh@50 -- # out='request: 00:12:26.306 { 00:12:26.306 "nqn": "nqn.2016-06.io.spdk:cnode23093", 00:12:26.306 "model_number": "SPDK_Controller\u001f", 00:12:26.306 "method": "nvmf_create_subsystem", 00:12:26.306 "req_id": 1 00:12:26.306 } 00:12:26.306 Got JSON-RPC error response 00:12:26.306 response: 00:12:26.306 { 00:12:26.306 "code": -32602, 00:12:26.306 "message": "Invalid MN SPDK_Controller\u001f" 00:12:26.306 }' 00:12:26.306 07:10:29 -- target/invalid.sh@51 -- # [[ request: 00:12:26.306 { 00:12:26.306 "nqn": "nqn.2016-06.io.spdk:cnode23093", 00:12:26.306 "model_number": "SPDK_Controller\u001f", 00:12:26.307 "method": "nvmf_create_subsystem", 00:12:26.307 "req_id": 1 00:12:26.307 } 00:12:26.307 Got JSON-RPC error response 00:12:26.307 response: 00:12:26.307 { 00:12:26.307 "code": -32602, 00:12:26.307 "message": "Invalid MN SPDK_Controller\u001f" 00:12:26.307 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:26.307 07:10:29 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:26.307 07:10:29 -- target/invalid.sh@19 -- # local length=21 ll 00:12:26.307 07:10:29 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:26.307 07:10:29 -- target/invalid.sh@21 -- # local chars 00:12:26.307 07:10:29 -- target/invalid.sh@22 -- # local string 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 109 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=m 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 74 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=J 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 62 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='>' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 120 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=x 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 124 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='|' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 58 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=: 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 126 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='~' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 61 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+== 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 80 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=P 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 92 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='\' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 123 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='{' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 74 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=J 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 61 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+== 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 106 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=j 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 59 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=';' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 108 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=l 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 78 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=N 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 125 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='}' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 34 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+='"' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 47 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=/ 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # printf %x 93 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:26.307 07:10:29 -- target/invalid.sh@25 -- # string+=']' 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.307 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.307 07:10:29 -- target/invalid.sh@28 -- # [[ m == \- ]] 00:12:26.307 07:10:29 -- target/invalid.sh@31 -- # echo 'mJ>x|:~=P\{J=j;lN}"/]' 00:12:26.307 07:10:29 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'mJ>x|:~=P\{J=j;lN}"/]' nqn.2016-06.io.spdk:cnode583 00:12:26.565 [2024-10-16 07:10:29.472762] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode583: invalid serial number 'mJ>x|:~=P\{J=j;lN}"/]' 00:12:26.565 07:10:29 -- target/invalid.sh@54 -- # out='request: 00:12:26.565 { 00:12:26.565 "nqn": "nqn.2016-06.io.spdk:cnode583", 00:12:26.565 "serial_number": "mJ>x|:~=P\\{J=j;lN}\"/]", 00:12:26.565 "method": "nvmf_create_subsystem", 00:12:26.565 "req_id": 1 00:12:26.565 } 00:12:26.565 Got JSON-RPC error response 00:12:26.565 response: 00:12:26.565 { 00:12:26.565 "code": -32602, 00:12:26.565 "message": "Invalid SN mJ>x|:~=P\\{J=j;lN}\"/]" 00:12:26.565 }' 00:12:26.565 07:10:29 -- target/invalid.sh@55 -- # [[ request: 00:12:26.565 { 00:12:26.565 "nqn": "nqn.2016-06.io.spdk:cnode583", 00:12:26.565 "serial_number": "mJ>x|:~=P\\{J=j;lN}\"/]", 00:12:26.565 "method": "nvmf_create_subsystem", 00:12:26.565 "req_id": 1 00:12:26.565 } 00:12:26.565 Got JSON-RPC error response 00:12:26.565 response: 00:12:26.565 { 00:12:26.565 "code": -32602, 00:12:26.565 "message": "Invalid SN mJ>x|:~=P\\{J=j;lN}\"/]" 00:12:26.565 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:26.565 07:10:29 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:26.565 07:10:29 -- target/invalid.sh@19 -- # local length=41 ll 00:12:26.565 07:10:29 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:26.565 07:10:29 -- target/invalid.sh@21 -- # local chars 00:12:26.565 07:10:29 -- target/invalid.sh@22 -- # local string 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # printf %x 108 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # string+=l 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # printf %x 74 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # string+=J 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # printf %x 112 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:26.565 07:10:29 -- target/invalid.sh@25 -- # string+=p 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.565 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 109 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=m 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 90 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=Z 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 96 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='`' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 61 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+== 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 73 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=I 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 81 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=Q 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 78 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=N 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 32 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=' ' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 82 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=R 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 70 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=F 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 76 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=L 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 118 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=v 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 117 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=u 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 123 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='{' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 121 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=y 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 67 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=C 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 84 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=T 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 83 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=S 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 95 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=_ 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 56 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=8 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 103 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=g 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 35 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='#' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 91 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='[' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 34 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='"' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 49 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=1 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 110 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=n 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 89 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=Y 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 125 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+='}' 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 69 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=E 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 68 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=D 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.824 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # printf %x 86 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:26.824 07:10:29 -- target/invalid.sh@25 -- # string+=V 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 52 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=4 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 76 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=L 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 35 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+='#' 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 83 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=S 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 44 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=, 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 59 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=';' 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # printf %x 74 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:26.825 07:10:29 -- target/invalid.sh@25 -- # string+=J 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:26.825 07:10:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:26.825 07:10:29 -- target/invalid.sh@28 -- # [[ l == \- ]] 00:12:26.825 07:10:29 -- target/invalid.sh@31 -- # echo 'lJpmZ`=IQN RFLvu{yCTS_8g#["1nY}EDV4L#S,;J' 00:12:26.825 07:10:29 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'lJpmZ`=IQN RFLvu{yCTS_8g#["1nY}EDV4L#S,;J' nqn.2016-06.io.spdk:cnode24812 00:12:27.083 [2024-10-16 07:10:29.878032] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24812: invalid model number 'lJpmZ`=IQN RFLvu{yCTS_8g#["1nY}EDV4L#S,;J' 00:12:27.083 07:10:29 -- target/invalid.sh@58 -- # out='request: 00:12:27.083 { 00:12:27.083 "nqn": "nqn.2016-06.io.spdk:cnode24812", 00:12:27.083 "model_number": "lJpmZ`=IQN RFLvu{yCTS_8g#[\"1nY}EDV4L#S,;J", 00:12:27.083 "method": "nvmf_create_subsystem", 00:12:27.083 "req_id": 1 00:12:27.083 } 00:12:27.083 Got JSON-RPC error response 00:12:27.083 response: 00:12:27.083 { 00:12:27.083 "code": -32602, 00:12:27.083 "message": "Invalid MN lJpmZ`=IQN RFLvu{yCTS_8g#[\"1nY}EDV4L#S,;J" 00:12:27.083 }' 00:12:27.083 07:10:29 -- target/invalid.sh@59 -- # [[ request: 00:12:27.083 { 00:12:27.083 "nqn": "nqn.2016-06.io.spdk:cnode24812", 00:12:27.083 "model_number": "lJpmZ`=IQN RFLvu{yCTS_8g#[\"1nY}EDV4L#S,;J", 00:12:27.083 "method": "nvmf_create_subsystem", 00:12:27.083 "req_id": 1 00:12:27.083 } 00:12:27.083 Got JSON-RPC error response 00:12:27.083 response: 00:12:27.083 { 00:12:27.083 "code": -32602, 00:12:27.083 "message": "Invalid MN lJpmZ`=IQN RFLvu{yCTS_8g#[\"1nY}EDV4L#S,;J" 00:12:27.083 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:27.083 07:10:29 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:27.341 [2024-10-16 07:10:30.134956] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:27.341 07:10:30 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:27.599 07:10:30 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:27.599 07:10:30 -- target/invalid.sh@67 -- # echo '' 00:12:27.599 07:10:30 -- target/invalid.sh@67 -- # head -n 1 00:12:27.599 07:10:30 -- target/invalid.sh@67 -- # IP= 00:12:27.599 07:10:30 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:27.856 [2024-10-16 07:10:30.680902] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:27.856 07:10:30 -- target/invalid.sh@69 -- # out='request: 00:12:27.856 { 00:12:27.856 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:27.856 "listen_address": { 00:12:27.856 "trtype": "tcp", 00:12:27.856 "traddr": "", 00:12:27.856 "trsvcid": "4421" 00:12:27.856 }, 00:12:27.856 "method": "nvmf_subsystem_remove_listener", 00:12:27.856 "req_id": 1 00:12:27.856 } 00:12:27.856 Got JSON-RPC error response 00:12:27.856 response: 00:12:27.856 { 00:12:27.856 "code": -32602, 00:12:27.856 "message": "Invalid parameters" 00:12:27.856 }' 00:12:27.856 07:10:30 -- target/invalid.sh@70 -- # [[ request: 00:12:27.856 { 00:12:27.856 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:27.856 "listen_address": { 00:12:27.856 "trtype": "tcp", 00:12:27.856 "traddr": "", 00:12:27.856 "trsvcid": "4421" 00:12:27.856 }, 00:12:27.856 "method": "nvmf_subsystem_remove_listener", 00:12:27.856 "req_id": 1 00:12:27.856 } 00:12:27.856 Got JSON-RPC error response 00:12:27.856 response: 00:12:27.856 { 00:12:27.856 "code": -32602, 00:12:27.856 "message": "Invalid parameters" 00:12:27.856 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:27.856 07:10:30 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14167 -i 0 00:12:28.114 [2024-10-16 07:10:30.925595] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14167: invalid cntlid range [0-65519] 00:12:28.114 07:10:30 -- target/invalid.sh@73 -- # out='request: 00:12:28.114 { 00:12:28.114 "nqn": "nqn.2016-06.io.spdk:cnode14167", 00:12:28.114 "min_cntlid": 0, 00:12:28.114 "method": "nvmf_create_subsystem", 00:12:28.114 "req_id": 1 00:12:28.114 } 00:12:28.114 Got JSON-RPC error response 00:12:28.114 response: 00:12:28.114 { 00:12:28.114 "code": -32602, 00:12:28.114 "message": "Invalid cntlid range [0-65519]" 00:12:28.114 }' 00:12:28.114 07:10:30 -- target/invalid.sh@74 -- # [[ request: 00:12:28.114 { 00:12:28.114 "nqn": "nqn.2016-06.io.spdk:cnode14167", 00:12:28.114 "min_cntlid": 0, 00:12:28.114 "method": "nvmf_create_subsystem", 00:12:28.114 "req_id": 1 00:12:28.114 } 00:12:28.114 Got JSON-RPC error response 00:12:28.114 response: 00:12:28.114 { 00:12:28.114 "code": -32602, 00:12:28.114 "message": "Invalid cntlid range [0-65519]" 00:12:28.114 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.114 07:10:30 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25127 -i 65520 00:12:28.371 [2024-10-16 07:10:31.178432] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25127: invalid cntlid range [65520-65519] 00:12:28.371 07:10:31 -- target/invalid.sh@75 -- # out='request: 00:12:28.371 { 00:12:28.371 "nqn": "nqn.2016-06.io.spdk:cnode25127", 00:12:28.371 "min_cntlid": 65520, 00:12:28.371 "method": "nvmf_create_subsystem", 00:12:28.371 "req_id": 1 00:12:28.371 } 00:12:28.371 Got JSON-RPC error response 00:12:28.371 response: 00:12:28.371 { 00:12:28.371 "code": -32602, 00:12:28.371 "message": "Invalid cntlid range [65520-65519]" 00:12:28.371 }' 00:12:28.371 07:10:31 -- target/invalid.sh@76 -- # [[ request: 00:12:28.371 { 00:12:28.371 "nqn": "nqn.2016-06.io.spdk:cnode25127", 00:12:28.371 "min_cntlid": 65520, 00:12:28.371 "method": "nvmf_create_subsystem", 00:12:28.371 "req_id": 1 00:12:28.371 } 00:12:28.371 Got JSON-RPC error response 00:12:28.371 response: 00:12:28.371 { 00:12:28.371 "code": -32602, 00:12:28.371 "message": "Invalid cntlid range [65520-65519]" 00:12:28.371 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.371 07:10:31 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32042 -I 0 00:12:28.629 [2024-10-16 07:10:31.431303] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32042: invalid cntlid range [1-0] 00:12:28.629 07:10:31 -- target/invalid.sh@77 -- # out='request: 00:12:28.629 { 00:12:28.629 "nqn": "nqn.2016-06.io.spdk:cnode32042", 00:12:28.629 "max_cntlid": 0, 00:12:28.629 "method": "nvmf_create_subsystem", 00:12:28.629 "req_id": 1 00:12:28.629 } 00:12:28.629 Got JSON-RPC error response 00:12:28.629 response: 00:12:28.629 { 00:12:28.629 "code": -32602, 00:12:28.629 "message": "Invalid cntlid range [1-0]" 00:12:28.629 }' 00:12:28.629 07:10:31 -- target/invalid.sh@78 -- # [[ request: 00:12:28.629 { 00:12:28.629 "nqn": "nqn.2016-06.io.spdk:cnode32042", 00:12:28.629 "max_cntlid": 0, 00:12:28.629 "method": "nvmf_create_subsystem", 00:12:28.629 "req_id": 1 00:12:28.629 } 00:12:28.629 Got JSON-RPC error response 00:12:28.629 response: 00:12:28.629 { 00:12:28.629 "code": -32602, 00:12:28.629 "message": "Invalid cntlid range [1-0]" 00:12:28.629 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.629 07:10:31 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22794 -I 65520 00:12:28.887 [2024-10-16 07:10:31.696250] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22794: invalid cntlid range [1-65520] 00:12:28.887 07:10:31 -- target/invalid.sh@79 -- # out='request: 00:12:28.887 { 00:12:28.887 "nqn": "nqn.2016-06.io.spdk:cnode22794", 00:12:28.887 "max_cntlid": 65520, 00:12:28.887 "method": "nvmf_create_subsystem", 00:12:28.887 "req_id": 1 00:12:28.887 } 00:12:28.887 Got JSON-RPC error response 00:12:28.887 response: 00:12:28.887 { 00:12:28.887 "code": -32602, 00:12:28.887 "message": "Invalid cntlid range [1-65520]" 00:12:28.887 }' 00:12:28.887 07:10:31 -- target/invalid.sh@80 -- # [[ request: 00:12:28.887 { 00:12:28.887 "nqn": "nqn.2016-06.io.spdk:cnode22794", 00:12:28.887 "max_cntlid": 65520, 00:12:28.887 "method": "nvmf_create_subsystem", 00:12:28.887 "req_id": 1 00:12:28.887 } 00:12:28.887 Got JSON-RPC error response 00:12:28.887 response: 00:12:28.887 { 00:12:28.887 "code": -32602, 00:12:28.887 "message": "Invalid cntlid range [1-65520]" 00:12:28.887 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:28.887 07:10:31 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18862 -i 6 -I 5 00:12:29.146 [2024-10-16 07:10:31.949109] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18862: invalid cntlid range [6-5] 00:12:29.146 07:10:31 -- target/invalid.sh@83 -- # out='request: 00:12:29.146 { 00:12:29.146 "nqn": "nqn.2016-06.io.spdk:cnode18862", 00:12:29.146 "min_cntlid": 6, 00:12:29.146 "max_cntlid": 5, 00:12:29.146 "method": "nvmf_create_subsystem", 00:12:29.146 "req_id": 1 00:12:29.146 } 00:12:29.146 Got JSON-RPC error response 00:12:29.146 response: 00:12:29.146 { 00:12:29.146 "code": -32602, 00:12:29.146 "message": "Invalid cntlid range [6-5]" 00:12:29.146 }' 00:12:29.146 07:10:31 -- target/invalid.sh@84 -- # [[ request: 00:12:29.146 { 00:12:29.146 "nqn": "nqn.2016-06.io.spdk:cnode18862", 00:12:29.146 "min_cntlid": 6, 00:12:29.146 "max_cntlid": 5, 00:12:29.146 "method": "nvmf_create_subsystem", 00:12:29.146 "req_id": 1 00:12:29.146 } 00:12:29.146 Got JSON-RPC error response 00:12:29.146 response: 00:12:29.146 { 00:12:29.146 "code": -32602, 00:12:29.146 "message": "Invalid cntlid range [6-5]" 00:12:29.146 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:29.146 07:10:31 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:29.146 07:10:32 -- target/invalid.sh@87 -- # out='request: 00:12:29.146 { 00:12:29.146 "name": "foobar", 00:12:29.146 "method": "nvmf_delete_target", 00:12:29.146 "req_id": 1 00:12:29.146 } 00:12:29.146 Got JSON-RPC error response 00:12:29.146 response: 00:12:29.146 { 00:12:29.146 "code": -32602, 00:12:29.146 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:29.146 }' 00:12:29.146 07:10:32 -- target/invalid.sh@88 -- # [[ request: 00:12:29.146 { 00:12:29.146 "name": "foobar", 00:12:29.146 "method": "nvmf_delete_target", 00:12:29.146 "req_id": 1 00:12:29.146 } 00:12:29.146 Got JSON-RPC error response 00:12:29.146 response: 00:12:29.146 { 00:12:29.146 "code": -32602, 00:12:29.146 "message": "The specified target doesn't exist, cannot delete it." 00:12:29.146 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:29.146 07:10:32 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:29.146 07:10:32 -- target/invalid.sh@91 -- # nvmftestfini 00:12:29.146 07:10:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:29.146 07:10:32 -- nvmf/common.sh@116 -- # sync 00:12:29.146 07:10:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:29.146 07:10:32 -- nvmf/common.sh@119 -- # set +e 00:12:29.146 07:10:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:29.146 07:10:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:29.404 rmmod nvme_tcp 00:12:29.404 rmmod nvme_fabrics 00:12:29.404 rmmod nvme_keyring 00:12:29.404 07:10:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:29.404 07:10:32 -- nvmf/common.sh@123 -- # set -e 00:12:29.404 07:10:32 -- nvmf/common.sh@124 -- # return 0 00:12:29.404 07:10:32 -- nvmf/common.sh@477 -- # '[' -n 1854391 ']' 00:12:29.404 07:10:32 -- nvmf/common.sh@478 -- # killprocess 1854391 00:12:29.404 07:10:32 -- common/autotest_common.sh@926 -- # '[' -z 1854391 ']' 00:12:29.404 07:10:32 -- common/autotest_common.sh@930 -- # kill -0 1854391 00:12:29.404 07:10:32 -- common/autotest_common.sh@931 -- # uname 00:12:29.404 07:10:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:29.404 07:10:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1854391 00:12:29.404 07:10:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:29.404 07:10:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:29.404 07:10:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1854391' 00:12:29.404 killing process with pid 1854391 00:12:29.404 07:10:32 -- common/autotest_common.sh@945 -- # kill 1854391 00:12:29.404 07:10:32 -- common/autotest_common.sh@950 -- # wait 1854391 00:12:29.662 07:10:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:29.662 07:10:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:29.662 07:10:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:29.662 07:10:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:29.662 07:10:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:29.662 07:10:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:29.662 07:10:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:29.662 07:10:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:31.564 07:10:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:31.564 00:12:31.564 real 0m9.515s 00:12:31.564 user 0m23.156s 00:12:31.564 sys 0m2.551s 00:12:31.564 07:10:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:31.564 07:10:34 -- common/autotest_common.sh@10 -- # set +x 00:12:31.564 ************************************ 00:12:31.564 END TEST nvmf_invalid 00:12:31.564 ************************************ 00:12:31.822 07:10:34 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:31.822 07:10:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:31.822 07:10:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:31.822 07:10:34 -- common/autotest_common.sh@10 -- # set +x 00:12:31.822 ************************************ 00:12:31.822 START TEST nvmf_abort 00:12:31.822 ************************************ 00:12:31.822 07:10:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:31.822 * Looking for test storage... 00:12:31.822 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:31.822 07:10:34 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:31.822 07:10:34 -- nvmf/common.sh@7 -- # uname -s 00:12:31.822 07:10:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:31.822 07:10:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:31.822 07:10:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:31.822 07:10:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:31.822 07:10:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:31.822 07:10:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:31.822 07:10:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:31.822 07:10:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:31.822 07:10:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:31.822 07:10:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:31.822 07:10:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:31.822 07:10:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:31.822 07:10:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:31.822 07:10:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:31.822 07:10:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:31.822 07:10:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:31.822 07:10:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:31.822 07:10:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:31.822 07:10:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:31.822 07:10:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.823 07:10:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.823 07:10:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.823 07:10:34 -- paths/export.sh@5 -- # export PATH 00:12:31.823 07:10:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:31.823 07:10:34 -- nvmf/common.sh@46 -- # : 0 00:12:31.823 07:10:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:31.823 07:10:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:31.823 07:10:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:31.823 07:10:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:31.823 07:10:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:31.823 07:10:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:31.823 07:10:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:31.823 07:10:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:31.823 07:10:34 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:31.823 07:10:34 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:31.823 07:10:34 -- target/abort.sh@14 -- # nvmftestinit 00:12:31.823 07:10:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:31.823 07:10:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:31.823 07:10:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:31.823 07:10:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:31.823 07:10:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:31.823 07:10:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:31.823 07:10:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:31.823 07:10:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:31.823 07:10:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:31.823 07:10:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:31.823 07:10:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:31.823 07:10:34 -- common/autotest_common.sh@10 -- # set +x 00:12:33.756 07:10:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:33.756 07:10:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:33.756 07:10:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:33.756 07:10:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:33.756 07:10:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:33.756 07:10:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:33.756 07:10:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:33.756 07:10:36 -- nvmf/common.sh@294 -- # net_devs=() 00:12:33.756 07:10:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:33.756 07:10:36 -- nvmf/common.sh@295 -- # e810=() 00:12:33.756 07:10:36 -- nvmf/common.sh@295 -- # local -ga e810 00:12:33.756 07:10:36 -- nvmf/common.sh@296 -- # x722=() 00:12:33.756 07:10:36 -- nvmf/common.sh@296 -- # local -ga x722 00:12:33.756 07:10:36 -- nvmf/common.sh@297 -- # mlx=() 00:12:33.756 07:10:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:33.756 07:10:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:33.756 07:10:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:33.756 07:10:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:33.756 07:10:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.756 07:10:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:33.756 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:33.756 07:10:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.756 07:10:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:33.756 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:33.756 07:10:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.756 07:10:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.756 07:10:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.756 07:10:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:33.756 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:33.756 07:10:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.756 07:10:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.756 07:10:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.756 07:10:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.756 07:10:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:33.756 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:33.756 07:10:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.756 07:10:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:33.756 07:10:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:33.756 07:10:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:33.756 07:10:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:33.756 07:10:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:33.756 07:10:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:33.756 07:10:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:33.756 07:10:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:33.756 07:10:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:33.756 07:10:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:33.756 07:10:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:33.756 07:10:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:33.757 07:10:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:33.757 07:10:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:33.757 07:10:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:33.757 07:10:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:34.052 07:10:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:34.052 07:10:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:34.052 07:10:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:34.052 07:10:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:34.052 07:10:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:34.052 07:10:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:34.052 07:10:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:34.052 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:34.052 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:12:34.052 00:12:34.052 --- 10.0.0.2 ping statistics --- 00:12:34.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:34.052 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:12:34.052 07:10:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:34.052 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:34.052 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:12:34.052 00:12:34.052 --- 10.0.0.1 ping statistics --- 00:12:34.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:34.052 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:12:34.052 07:10:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:34.052 07:10:36 -- nvmf/common.sh@410 -- # return 0 00:12:34.052 07:10:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:34.052 07:10:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:34.052 07:10:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:34.052 07:10:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:34.052 07:10:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:34.052 07:10:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:34.052 07:10:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:34.052 07:10:36 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:34.052 07:10:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:34.052 07:10:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:34.052 07:10:36 -- common/autotest_common.sh@10 -- # set +x 00:12:34.052 07:10:36 -- nvmf/common.sh@469 -- # nvmfpid=1857063 00:12:34.052 07:10:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:34.052 07:10:36 -- nvmf/common.sh@470 -- # waitforlisten 1857063 00:12:34.052 07:10:36 -- common/autotest_common.sh@819 -- # '[' -z 1857063 ']' 00:12:34.052 07:10:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:34.052 07:10:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:34.052 07:10:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:34.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:34.052 07:10:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:34.052 07:10:36 -- common/autotest_common.sh@10 -- # set +x 00:12:34.052 [2024-10-16 07:10:36.924340] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:12:34.052 [2024-10-16 07:10:36.924410] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:34.052 EAL: No free 2048 kB hugepages reported on node 1 00:12:34.311 [2024-10-16 07:10:36.987506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:34.311 [2024-10-16 07:10:37.098674] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:34.311 [2024-10-16 07:10:37.098847] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:34.311 [2024-10-16 07:10:37.098866] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:34.311 [2024-10-16 07:10:37.098878] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:34.311 [2024-10-16 07:10:37.098980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:34.311 [2024-10-16 07:10:37.099043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:34.311 [2024-10-16 07:10:37.099046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:35.244 07:10:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:35.244 07:10:37 -- common/autotest_common.sh@852 -- # return 0 00:12:35.244 07:10:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:35.244 07:10:37 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:35.244 07:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:35.244 07:10:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:35.244 07:10:37 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:35.244 07:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.244 07:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:35.244 [2024-10-16 07:10:37.970321] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:35.245 07:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:37 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:35.245 07:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 Malloc0 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:35.245 07:10:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:38 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 Delay0 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:35.245 07:10:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:38 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:35.245 07:10:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:38 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:35.245 07:10:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:38 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 [2024-10-16 07:10:38.036828] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:35.245 07:10:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:35.245 07:10:38 -- common/autotest_common.sh@10 -- # set +x 00:12:35.245 07:10:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:35.245 07:10:38 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:35.245 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.245 [2024-10-16 07:10:38.131863] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:37.774 Initializing NVMe Controllers 00:12:37.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:37.774 controller IO queue size 128 less than required 00:12:37.774 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:37.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:37.774 Initialization complete. Launching workers. 00:12:37.774 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 32251 00:12:37.774 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 32312, failed to submit 62 00:12:37.774 success 32251, unsuccess 61, failed 0 00:12:37.774 07:10:40 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:37.774 07:10:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.774 07:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:37.774 07:10:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.774 07:10:40 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:37.774 07:10:40 -- target/abort.sh@38 -- # nvmftestfini 00:12:37.774 07:10:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:37.774 07:10:40 -- nvmf/common.sh@116 -- # sync 00:12:37.774 07:10:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:37.774 07:10:40 -- nvmf/common.sh@119 -- # set +e 00:12:37.774 07:10:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:37.774 07:10:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:37.774 rmmod nvme_tcp 00:12:37.774 rmmod nvme_fabrics 00:12:37.774 rmmod nvme_keyring 00:12:37.774 07:10:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:37.774 07:10:40 -- nvmf/common.sh@123 -- # set -e 00:12:37.774 07:10:40 -- nvmf/common.sh@124 -- # return 0 00:12:37.774 07:10:40 -- nvmf/common.sh@477 -- # '[' -n 1857063 ']' 00:12:37.774 07:10:40 -- nvmf/common.sh@478 -- # killprocess 1857063 00:12:37.774 07:10:40 -- common/autotest_common.sh@926 -- # '[' -z 1857063 ']' 00:12:37.774 07:10:40 -- common/autotest_common.sh@930 -- # kill -0 1857063 00:12:37.774 07:10:40 -- common/autotest_common.sh@931 -- # uname 00:12:37.774 07:10:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:37.774 07:10:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1857063 00:12:37.774 07:10:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:37.774 07:10:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:37.774 07:10:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1857063' 00:12:37.774 killing process with pid 1857063 00:12:37.774 07:10:40 -- common/autotest_common.sh@945 -- # kill 1857063 00:12:37.774 07:10:40 -- common/autotest_common.sh@950 -- # wait 1857063 00:12:37.774 07:10:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:37.774 07:10:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:37.774 07:10:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:37.774 07:10:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:37.774 07:10:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:37.774 07:10:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.774 07:10:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.774 07:10:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:40.310 07:10:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:40.310 00:12:40.310 real 0m8.109s 00:12:40.310 user 0m12.844s 00:12:40.310 sys 0m2.558s 00:12:40.310 07:10:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:40.310 07:10:42 -- common/autotest_common.sh@10 -- # set +x 00:12:40.310 ************************************ 00:12:40.310 END TEST nvmf_abort 00:12:40.310 ************************************ 00:12:40.310 07:10:42 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:40.310 07:10:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:40.310 07:10:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:40.310 07:10:42 -- common/autotest_common.sh@10 -- # set +x 00:12:40.310 ************************************ 00:12:40.310 START TEST nvmf_ns_hotplug_stress 00:12:40.310 ************************************ 00:12:40.310 07:10:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:40.310 * Looking for test storage... 00:12:40.310 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:40.310 07:10:42 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:40.310 07:10:42 -- nvmf/common.sh@7 -- # uname -s 00:12:40.310 07:10:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:40.310 07:10:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:40.310 07:10:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:40.310 07:10:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:40.310 07:10:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:40.310 07:10:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:40.310 07:10:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:40.310 07:10:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:40.310 07:10:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:40.310 07:10:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:40.310 07:10:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.310 07:10:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:40.310 07:10:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:40.310 07:10:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:40.310 07:10:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:40.310 07:10:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:40.311 07:10:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:40.311 07:10:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:40.311 07:10:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:40.311 07:10:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.311 07:10:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.311 07:10:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.311 07:10:42 -- paths/export.sh@5 -- # export PATH 00:12:40.311 07:10:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:40.311 07:10:42 -- nvmf/common.sh@46 -- # : 0 00:12:40.311 07:10:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:40.311 07:10:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:40.311 07:10:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:40.311 07:10:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:40.311 07:10:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:40.311 07:10:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:40.311 07:10:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:40.311 07:10:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:40.311 07:10:42 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:40.311 07:10:42 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:40.311 07:10:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:40.311 07:10:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:40.311 07:10:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:40.311 07:10:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:40.311 07:10:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:40.311 07:10:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.311 07:10:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.311 07:10:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:40.311 07:10:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:40.311 07:10:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:40.311 07:10:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:40.311 07:10:42 -- common/autotest_common.sh@10 -- # set +x 00:12:42.211 07:10:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:42.211 07:10:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:42.211 07:10:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:42.211 07:10:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:42.211 07:10:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:42.211 07:10:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:42.211 07:10:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:42.211 07:10:44 -- nvmf/common.sh@294 -- # net_devs=() 00:12:42.211 07:10:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:42.211 07:10:44 -- nvmf/common.sh@295 -- # e810=() 00:12:42.211 07:10:44 -- nvmf/common.sh@295 -- # local -ga e810 00:12:42.211 07:10:44 -- nvmf/common.sh@296 -- # x722=() 00:12:42.211 07:10:44 -- nvmf/common.sh@296 -- # local -ga x722 00:12:42.211 07:10:44 -- nvmf/common.sh@297 -- # mlx=() 00:12:42.211 07:10:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:42.211 07:10:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:42.211 07:10:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:42.211 07:10:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:42.211 07:10:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:42.211 07:10:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.211 07:10:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:42.211 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:42.211 07:10:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:42.211 07:10:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:42.211 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:42.211 07:10:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:42.211 07:10:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:42.212 07:10:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.212 07:10:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.212 07:10:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.212 07:10:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.212 07:10:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:42.212 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:42.212 07:10:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.212 07:10:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:42.212 07:10:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.212 07:10:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:42.212 07:10:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.212 07:10:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:42.212 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:42.212 07:10:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.212 07:10:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:42.212 07:10:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:42.212 07:10:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:42.212 07:10:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:42.212 07:10:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:42.212 07:10:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:42.212 07:10:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:42.212 07:10:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:42.212 07:10:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:42.212 07:10:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:42.212 07:10:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:42.212 07:10:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:42.212 07:10:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:42.212 07:10:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:42.212 07:10:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:42.212 07:10:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:42.212 07:10:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:42.212 07:10:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:42.212 07:10:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:42.212 07:10:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:42.212 07:10:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:42.212 07:10:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:42.212 07:10:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:42.212 07:10:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:42.212 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:42.212 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:12:42.212 00:12:42.212 --- 10.0.0.2 ping statistics --- 00:12:42.212 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.212 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:12:42.212 07:10:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:42.212 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:42.212 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:12:42.212 00:12:42.212 --- 10.0.0.1 ping statistics --- 00:12:42.212 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:42.212 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:12:42.212 07:10:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:42.212 07:10:45 -- nvmf/common.sh@410 -- # return 0 00:12:42.212 07:10:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:42.212 07:10:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:42.212 07:10:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:42.212 07:10:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:42.212 07:10:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:42.212 07:10:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:42.212 07:10:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:42.212 07:10:45 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:42.212 07:10:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:42.212 07:10:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:42.212 07:10:45 -- common/autotest_common.sh@10 -- # set +x 00:12:42.212 07:10:45 -- nvmf/common.sh@469 -- # nvmfpid=1859437 00:12:42.212 07:10:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:42.212 07:10:45 -- nvmf/common.sh@470 -- # waitforlisten 1859437 00:12:42.212 07:10:45 -- common/autotest_common.sh@819 -- # '[' -z 1859437 ']' 00:12:42.212 07:10:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:42.212 07:10:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:42.212 07:10:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:42.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:42.212 07:10:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:42.212 07:10:45 -- common/autotest_common.sh@10 -- # set +x 00:12:42.212 [2024-10-16 07:10:45.105858] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:12:42.212 [2024-10-16 07:10:45.105926] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:42.212 EAL: No free 2048 kB hugepages reported on node 1 00:12:42.470 [2024-10-16 07:10:45.169492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:42.470 [2024-10-16 07:10:45.274369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:42.470 [2024-10-16 07:10:45.274535] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:42.470 [2024-10-16 07:10:45.274554] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:42.470 [2024-10-16 07:10:45.274567] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:42.470 [2024-10-16 07:10:45.274698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:42.470 [2024-10-16 07:10:45.274791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:42.470 [2024-10-16 07:10:45.274796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:43.402 07:10:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:43.402 07:10:46 -- common/autotest_common.sh@852 -- # return 0 00:12:43.402 07:10:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:43.402 07:10:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:43.402 07:10:46 -- common/autotest_common.sh@10 -- # set +x 00:12:43.402 07:10:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:43.402 07:10:46 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:43.402 07:10:46 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:43.661 [2024-10-16 07:10:46.400612] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:43.661 07:10:46 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:43.918 07:10:46 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:44.179 [2024-10-16 07:10:46.919682] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:44.179 07:10:46 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:44.438 07:10:47 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:44.695 Malloc0 00:12:44.695 07:10:47 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:44.952 Delay0 00:12:44.952 07:10:47 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.209 07:10:47 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:45.467 NULL1 00:12:45.467 07:10:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:45.725 07:10:48 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1859873 00:12:45.725 07:10:48 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:45.725 07:10:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:45.725 07:10:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.725 EAL: No free 2048 kB hugepages reported on node 1 00:12:46.658 Read completed with error (sct=0, sc=11) 00:12:46.658 07:10:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.916 07:10:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:46.916 07:10:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:47.174 true 00:12:47.432 07:10:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:47.432 07:10:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.997 07:10:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.997 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.255 07:10:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:48.255 07:10:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:48.512 true 00:12:48.512 07:10:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:48.512 07:10:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.770 07:10:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.028 07:10:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:49.028 07:10:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:49.286 true 00:12:49.286 07:10:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:49.286 07:10:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.543 07:10:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.801 07:10:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:49.801 07:10:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:50.059 true 00:12:50.059 07:10:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:50.059 07:10:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.432 07:10:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.432 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.432 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.432 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.432 07:10:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:51.432 07:10:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:51.689 true 00:12:51.689 07:10:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:51.689 07:10:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.947 07:10:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.204 07:10:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:52.204 07:10:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:52.462 true 00:12:52.462 07:10:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:52.462 07:10:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.394 07:10:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.394 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:53.652 07:10:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:53.652 07:10:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:53.909 true 00:12:53.909 07:10:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:53.909 07:10:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.167 07:10:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.425 07:10:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:54.425 07:10:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:54.425 true 00:12:54.682 07:10:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:54.682 07:10:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.615 07:10:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.615 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:55.873 07:10:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:55.873 07:10:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:56.131 true 00:12:56.131 07:10:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:56.131 07:10:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.390 07:10:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.647 07:10:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:56.647 07:10:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:56.905 true 00:12:56.905 07:10:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:56.905 07:10:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.838 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.838 07:11:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.838 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.838 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.838 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.838 07:11:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:57.838 07:11:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:58.096 true 00:12:58.096 07:11:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:58.096 07:11:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.353 07:11:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.611 07:11:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:58.611 07:11:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:58.868 true 00:12:58.868 07:11:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:12:58.868 07:11:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.800 07:11:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.058 07:11:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:00.058 07:11:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:00.316 true 00:13:00.316 07:11:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:00.316 07:11:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.621 07:11:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.904 07:11:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:00.904 07:11:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:01.161 true 00:13:01.161 07:11:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:01.162 07:11:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.419 07:11:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.677 07:11:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:01.677 07:11:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:01.934 true 00:13:01.934 07:11:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:01.934 07:11:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.927 07:11:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.183 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.183 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.183 07:11:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:03.183 07:11:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:03.440 true 00:13:03.440 07:11:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:03.440 07:11:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.373 07:11:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.373 07:11:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:04.373 07:11:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:04.630 true 00:13:04.630 07:11:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:04.630 07:11:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.887 07:11:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.145 07:11:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:05.145 07:11:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:05.403 true 00:13:05.403 07:11:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:05.403 07:11:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.335 07:11:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.593 07:11:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:06.593 07:11:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:06.850 true 00:13:06.850 07:11:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:06.850 07:11:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.108 07:11:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.365 07:11:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:07.365 07:11:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:07.365 true 00:13:07.365 07:11:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:07.365 07:11:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.930 07:11:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.930 07:11:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:07.930 07:11:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:08.188 true 00:13:08.188 07:11:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:08.188 07:11:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.121 07:11:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.687 07:11:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:09.687 07:11:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:09.687 true 00:13:09.687 07:11:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:09.687 07:11:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.945 07:11:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.203 07:11:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:10.203 07:11:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:10.460 true 00:13:10.460 07:11:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:10.460 07:11:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.718 07:11:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.976 07:11:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:10.976 07:11:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:11.233 true 00:13:11.233 07:11:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:11.233 07:11:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.606 07:11:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.606 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.606 07:11:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:12.606 07:11:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:12.863 true 00:13:12.863 07:11:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:12.863 07:11:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.121 07:11:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.379 07:11:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:13.379 07:11:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:13.637 true 00:13:13.637 07:11:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:13.637 07:11:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.572 07:11:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.572 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.830 07:11:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:14.830 07:11:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:15.088 true 00:13:15.088 07:11:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:15.088 07:11:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.346 07:11:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.603 07:11:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:15.603 07:11:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:15.603 true 00:13:15.861 07:11:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:15.861 07:11:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.795 Initializing NVMe Controllers 00:13:16.795 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:16.795 Controller IO queue size 128, less than required. 00:13:16.795 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:16.795 Controller IO queue size 128, less than required. 00:13:16.795 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:16.795 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:16.795 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:16.795 Initialization complete. Launching workers. 00:13:16.795 ======================================================== 00:13:16.795 Latency(us) 00:13:16.795 Device Information : IOPS MiB/s Average min max 00:13:16.795 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 993.33 0.49 67819.73 1835.55 1206075.74 00:13:16.795 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11647.30 5.69 10989.98 2198.89 445577.10 00:13:16.795 ======================================================== 00:13:16.795 Total : 12640.63 6.17 15455.79 1835.55 1206075.74 00:13:16.795 00:13:16.795 07:11:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.795 07:11:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:16.795 07:11:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:17.053 true 00:13:17.053 07:11:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1859873 00:13:17.053 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1859873) - No such process 00:13:17.053 07:11:19 -- target/ns_hotplug_stress.sh@53 -- # wait 1859873 00:13:17.053 07:11:19 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.312 07:11:20 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.569 07:11:20 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:17.569 07:11:20 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:17.569 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:17.569 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.569 07:11:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:17.827 null0 00:13:17.827 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:17.827 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:17.827 07:11:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:18.086 null1 00:13:18.086 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.086 07:11:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.086 07:11:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:18.346 null2 00:13:18.346 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.346 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.346 07:11:21 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:18.604 null3 00:13:18.604 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.604 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.604 07:11:21 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:18.862 null4 00:13:18.862 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:18.862 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:18.862 07:11:21 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:19.120 null5 00:13:19.120 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.120 07:11:21 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.120 07:11:21 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:19.377 null6 00:13:19.377 07:11:22 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.377 07:11:22 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.377 07:11:22 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:19.635 null7 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:19.635 07:11:22 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:19.636 07:11:22 -- target/ns_hotplug_stress.sh@66 -- # wait 1864169 1864170 1864171 1864174 1864176 1864178 1864180 1864182 00:13:19.636 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:19.636 07:11:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.636 07:11:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.894 07:11:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.152 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.410 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.410 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.410 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.668 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.668 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.669 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.669 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.669 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.926 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.927 07:11:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.184 07:11:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.443 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:21.701 07:11:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:21.959 07:11:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.218 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.477 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.735 07:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.993 07:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.252 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.510 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.077 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.335 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.335 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.335 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.593 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.916 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.174 07:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:25.432 07:11:28 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:25.432 07:11:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:25.432 07:11:28 -- nvmf/common.sh@116 -- # sync 00:13:25.432 07:11:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:25.432 07:11:28 -- nvmf/common.sh@119 -- # set +e 00:13:25.432 07:11:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:25.432 07:11:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:25.432 rmmod nvme_tcp 00:13:25.432 rmmod nvme_fabrics 00:13:25.432 rmmod nvme_keyring 00:13:25.432 07:11:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:25.432 07:11:28 -- nvmf/common.sh@123 -- # set -e 00:13:25.432 07:11:28 -- nvmf/common.sh@124 -- # return 0 00:13:25.432 07:11:28 -- nvmf/common.sh@477 -- # '[' -n 1859437 ']' 00:13:25.432 07:11:28 -- nvmf/common.sh@478 -- # killprocess 1859437 00:13:25.432 07:11:28 -- common/autotest_common.sh@926 -- # '[' -z 1859437 ']' 00:13:25.432 07:11:28 -- common/autotest_common.sh@930 -- # kill -0 1859437 00:13:25.432 07:11:28 -- common/autotest_common.sh@931 -- # uname 00:13:25.432 07:11:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:25.432 07:11:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1859437 00:13:25.432 07:11:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:25.432 07:11:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:25.432 07:11:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1859437' 00:13:25.432 killing process with pid 1859437 00:13:25.432 07:11:28 -- common/autotest_common.sh@945 -- # kill 1859437 00:13:25.432 07:11:28 -- common/autotest_common.sh@950 -- # wait 1859437 00:13:25.690 07:11:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:25.690 07:11:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:25.690 07:11:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:25.690 07:11:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:25.690 07:11:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:25.690 07:11:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:25.690 07:11:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:25.690 07:11:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.223 07:11:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:28.223 00:13:28.223 real 0m47.955s 00:13:28.223 user 3m38.599s 00:13:28.223 sys 0m15.496s 00:13:28.223 07:11:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:28.223 07:11:30 -- common/autotest_common.sh@10 -- # set +x 00:13:28.223 ************************************ 00:13:28.223 END TEST nvmf_ns_hotplug_stress 00:13:28.223 ************************************ 00:13:28.223 07:11:30 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:28.223 07:11:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:28.223 07:11:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:28.223 07:11:30 -- common/autotest_common.sh@10 -- # set +x 00:13:28.223 ************************************ 00:13:28.223 START TEST nvmf_connect_stress 00:13:28.223 ************************************ 00:13:28.223 07:11:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:28.223 * Looking for test storage... 00:13:28.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:28.223 07:11:30 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:28.223 07:11:30 -- nvmf/common.sh@7 -- # uname -s 00:13:28.223 07:11:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:28.223 07:11:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:28.223 07:11:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:28.223 07:11:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:28.223 07:11:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:28.223 07:11:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:28.223 07:11:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:28.223 07:11:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:28.223 07:11:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:28.223 07:11:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:28.223 07:11:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.223 07:11:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.223 07:11:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:28.223 07:11:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:28.223 07:11:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:28.223 07:11:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:28.223 07:11:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:28.223 07:11:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:28.223 07:11:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:28.223 07:11:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.223 07:11:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.223 07:11:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.223 07:11:30 -- paths/export.sh@5 -- # export PATH 00:13:28.223 07:11:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.223 07:11:30 -- nvmf/common.sh@46 -- # : 0 00:13:28.223 07:11:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:28.223 07:11:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:28.223 07:11:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:28.223 07:11:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:28.223 07:11:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:28.223 07:11:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:28.223 07:11:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:28.223 07:11:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:28.223 07:11:30 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:28.223 07:11:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:28.223 07:11:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:28.223 07:11:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:28.223 07:11:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:28.223 07:11:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:28.223 07:11:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.223 07:11:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.223 07:11:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.223 07:11:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.223 07:11:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.223 07:11:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.223 07:11:30 -- common/autotest_common.sh@10 -- # set +x 00:13:30.125 07:11:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.125 07:11:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.125 07:11:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.126 07:11:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.126 07:11:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.126 07:11:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.126 07:11:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.126 07:11:32 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.126 07:11:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.126 07:11:32 -- nvmf/common.sh@295 -- # e810=() 00:13:30.126 07:11:32 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.126 07:11:32 -- nvmf/common.sh@296 -- # x722=() 00:13:30.126 07:11:32 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.126 07:11:32 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.126 07:11:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.126 07:11:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.126 07:11:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.126 07:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.126 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.126 07:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.126 07:11:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.126 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.126 07:11:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.126 07:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.126 07:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.126 07:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.126 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.126 07:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.126 07:11:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.126 07:11:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.126 07:11:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.126 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.126 07:11:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.126 07:11:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.126 07:11:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.126 07:11:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.126 07:11:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.126 07:11:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:30.126 07:11:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:30.126 07:11:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:30.126 07:11:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:30.126 07:11:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:30.126 07:11:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:30.126 07:11:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:30.126 07:11:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:30.126 07:11:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:30.126 07:11:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:30.126 07:11:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:30.126 07:11:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:30.126 07:11:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:30.126 07:11:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:30.126 07:11:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:30.126 07:11:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:30.126 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:30.126 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:13:30.126 00:13:30.126 --- 10.0.0.2 ping statistics --- 00:13:30.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.126 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:13:30.126 07:11:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:30.126 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:30.126 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:13:30.126 00:13:30.126 --- 10.0.0.1 ping statistics --- 00:13:30.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.126 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:13:30.126 07:11:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:30.126 07:11:32 -- nvmf/common.sh@410 -- # return 0 00:13:30.126 07:11:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:30.126 07:11:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:30.126 07:11:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:30.126 07:11:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:30.126 07:11:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:30.126 07:11:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:30.126 07:11:32 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:30.126 07:11:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:30.126 07:11:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:30.126 07:11:32 -- common/autotest_common.sh@10 -- # set +x 00:13:30.126 07:11:32 -- nvmf/common.sh@469 -- # nvmfpid=1866960 00:13:30.126 07:11:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:30.126 07:11:32 -- nvmf/common.sh@470 -- # waitforlisten 1866960 00:13:30.126 07:11:32 -- common/autotest_common.sh@819 -- # '[' -z 1866960 ']' 00:13:30.126 07:11:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.126 07:11:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:30.126 07:11:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.126 07:11:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:30.126 07:11:32 -- common/autotest_common.sh@10 -- # set +x 00:13:30.126 [2024-10-16 07:11:33.025511] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:30.126 [2024-10-16 07:11:33.025594] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.126 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.385 [2024-10-16 07:11:33.094297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:30.385 [2024-10-16 07:11:33.199817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:30.385 [2024-10-16 07:11:33.199996] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.385 [2024-10-16 07:11:33.200029] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.385 [2024-10-16 07:11:33.200041] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.385 [2024-10-16 07:11:33.200097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:30.385 [2024-10-16 07:11:33.200174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.385 [2024-10-16 07:11:33.200178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:31.318 07:11:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:31.318 07:11:33 -- common/autotest_common.sh@852 -- # return 0 00:13:31.318 07:11:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:31.318 07:11:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:31.318 07:11:33 -- common/autotest_common.sh@10 -- # set +x 00:13:31.318 07:11:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:31.318 07:11:34 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:31.318 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.318 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.318 [2024-10-16 07:11:34.022473] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:31.318 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.318 07:11:34 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:31.318 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.318 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.318 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.318 07:11:34 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.318 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.318 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.318 [2024-10-16 07:11:34.058895] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.318 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.318 07:11:34 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:31.318 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.318 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.318 NULL1 00:13:31.318 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.318 07:11:34 -- target/connect_stress.sh@21 -- # PERF_PID=1867124 00:13:31.318 07:11:34 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:31.318 07:11:34 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:31.318 07:11:34 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:31.318 07:11:34 -- target/connect_stress.sh@28 -- # cat 00:13:31.318 07:11:34 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:31.318 07:11:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.318 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.318 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.576 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.576 07:11:34 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:31.576 07:11:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.577 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.577 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:31.834 07:11:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.834 07:11:34 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:31.834 07:11:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.834 07:11:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.834 07:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:32.399 07:11:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.399 07:11:35 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:32.399 07:11:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.399 07:11:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.399 07:11:35 -- common/autotest_common.sh@10 -- # set +x 00:13:32.657 07:11:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.657 07:11:35 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:32.657 07:11:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.657 07:11:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.657 07:11:35 -- common/autotest_common.sh@10 -- # set +x 00:13:32.915 07:11:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.915 07:11:35 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:32.915 07:11:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.915 07:11:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.915 07:11:35 -- common/autotest_common.sh@10 -- # set +x 00:13:33.172 07:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:33.172 07:11:36 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:33.172 07:11:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.172 07:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:33.172 07:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:33.430 07:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:33.430 07:11:36 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:33.430 07:11:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.430 07:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:33.430 07:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:33.995 07:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:33.995 07:11:36 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:33.995 07:11:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.995 07:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:33.995 07:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:34.253 07:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.253 07:11:37 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:34.253 07:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.253 07:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.253 07:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:34.511 07:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.511 07:11:37 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:34.511 07:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.511 07:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.511 07:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:34.768 07:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.768 07:11:37 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:34.768 07:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.768 07:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.768 07:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:35.333 07:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.333 07:11:37 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:35.333 07:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.333 07:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.333 07:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:35.591 07:11:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.591 07:11:38 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:35.591 07:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.591 07:11:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.591 07:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.849 07:11:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.849 07:11:38 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:35.849 07:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.849 07:11:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.849 07:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:36.106 07:11:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:36.106 07:11:38 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:36.106 07:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.106 07:11:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:36.106 07:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:36.364 07:11:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:36.364 07:11:39 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:36.364 07:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.364 07:11:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:36.364 07:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:36.708 07:11:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:36.708 07:11:39 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:36.708 07:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.708 07:11:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:36.708 07:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:36.965 07:11:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:36.965 07:11:39 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:36.965 07:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.965 07:11:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:36.965 07:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:37.531 07:11:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:37.531 07:11:40 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:37.531 07:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.531 07:11:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:37.531 07:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:37.789 07:11:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:37.789 07:11:40 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:37.789 07:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.789 07:11:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:37.789 07:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:38.046 07:11:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.046 07:11:40 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:38.046 07:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.046 07:11:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.046 07:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:38.303 07:11:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.303 07:11:41 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:38.303 07:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.303 07:11:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.303 07:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:38.869 07:11:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.869 07:11:41 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:38.869 07:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.869 07:11:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.869 07:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:39.126 07:11:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:39.126 07:11:41 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:39.126 07:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.126 07:11:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:39.126 07:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:39.384 07:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:39.384 07:11:42 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:39.384 07:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.384 07:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:39.384 07:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:39.641 07:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:39.641 07:11:42 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:39.641 07:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.641 07:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:39.641 07:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:39.899 07:11:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:39.899 07:11:42 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:39.899 07:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.899 07:11:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:39.899 07:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:40.465 07:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:40.465 07:11:43 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:40.465 07:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.465 07:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:40.465 07:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.723 07:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:40.723 07:11:43 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:40.723 07:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.723 07:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:40.723 07:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:40.981 07:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:40.981 07:11:43 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:40.981 07:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.981 07:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:40.981 07:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:41.239 07:11:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:41.239 07:11:44 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:41.239 07:11:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.239 07:11:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:41.239 07:11:44 -- common/autotest_common.sh@10 -- # set +x 00:13:41.239 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:41.496 07:11:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:41.496 07:11:44 -- target/connect_stress.sh@34 -- # kill -0 1867124 00:13:41.496 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1867124) - No such process 00:13:41.496 07:11:44 -- target/connect_stress.sh@38 -- # wait 1867124 00:13:41.496 07:11:44 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:41.496 07:11:44 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:41.496 07:11:44 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:41.496 07:11:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:41.496 07:11:44 -- nvmf/common.sh@116 -- # sync 00:13:41.496 07:11:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:41.496 07:11:44 -- nvmf/common.sh@119 -- # set +e 00:13:41.496 07:11:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:41.496 07:11:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:41.496 rmmod nvme_tcp 00:13:41.496 rmmod nvme_fabrics 00:13:41.496 rmmod nvme_keyring 00:13:41.755 07:11:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:41.755 07:11:44 -- nvmf/common.sh@123 -- # set -e 00:13:41.755 07:11:44 -- nvmf/common.sh@124 -- # return 0 00:13:41.755 07:11:44 -- nvmf/common.sh@477 -- # '[' -n 1866960 ']' 00:13:41.755 07:11:44 -- nvmf/common.sh@478 -- # killprocess 1866960 00:13:41.755 07:11:44 -- common/autotest_common.sh@926 -- # '[' -z 1866960 ']' 00:13:41.755 07:11:44 -- common/autotest_common.sh@930 -- # kill -0 1866960 00:13:41.755 07:11:44 -- common/autotest_common.sh@931 -- # uname 00:13:41.755 07:11:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:41.755 07:11:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1866960 00:13:41.755 07:11:44 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:41.755 07:11:44 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:41.755 07:11:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1866960' 00:13:41.755 killing process with pid 1866960 00:13:41.755 07:11:44 -- common/autotest_common.sh@945 -- # kill 1866960 00:13:41.755 07:11:44 -- common/autotest_common.sh@950 -- # wait 1866960 00:13:42.013 07:11:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:42.013 07:11:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:42.013 07:11:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:42.013 07:11:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:42.013 07:11:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:42.014 07:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.014 07:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.014 07:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.915 07:11:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:43.915 00:13:43.915 real 0m16.189s 00:13:43.915 user 0m40.952s 00:13:43.915 sys 0m5.793s 00:13:43.915 07:11:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:43.915 07:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.915 ************************************ 00:13:43.915 END TEST nvmf_connect_stress 00:13:43.915 ************************************ 00:13:43.916 07:11:46 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:43.916 07:11:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:43.916 07:11:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:43.916 07:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.916 ************************************ 00:13:43.916 START TEST nvmf_fused_ordering 00:13:43.916 ************************************ 00:13:43.916 07:11:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:44.174 * Looking for test storage... 00:13:44.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:44.174 07:11:46 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:44.174 07:11:46 -- nvmf/common.sh@7 -- # uname -s 00:13:44.174 07:11:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:44.174 07:11:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:44.174 07:11:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:44.174 07:11:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:44.174 07:11:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:44.174 07:11:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:44.174 07:11:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:44.174 07:11:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:44.174 07:11:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:44.174 07:11:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:44.174 07:11:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:44.174 07:11:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:44.174 07:11:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:44.174 07:11:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:44.174 07:11:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:44.174 07:11:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:44.174 07:11:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:44.174 07:11:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:44.174 07:11:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:44.174 07:11:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.174 07:11:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.174 07:11:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.174 07:11:46 -- paths/export.sh@5 -- # export PATH 00:13:44.174 07:11:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.174 07:11:46 -- nvmf/common.sh@46 -- # : 0 00:13:44.174 07:11:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:44.174 07:11:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:44.174 07:11:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:44.174 07:11:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:44.174 07:11:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:44.174 07:11:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:44.174 07:11:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:44.174 07:11:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:44.174 07:11:46 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:44.174 07:11:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:44.174 07:11:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:44.174 07:11:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:44.174 07:11:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:44.174 07:11:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:44.174 07:11:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.174 07:11:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.174 07:11:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:44.174 07:11:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:44.174 07:11:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:44.174 07:11:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:44.174 07:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:46.076 07:11:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:46.076 07:11:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:46.076 07:11:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:46.076 07:11:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:46.076 07:11:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:46.076 07:11:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:46.076 07:11:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:46.076 07:11:48 -- nvmf/common.sh@294 -- # net_devs=() 00:13:46.076 07:11:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:46.076 07:11:48 -- nvmf/common.sh@295 -- # e810=() 00:13:46.076 07:11:48 -- nvmf/common.sh@295 -- # local -ga e810 00:13:46.076 07:11:48 -- nvmf/common.sh@296 -- # x722=() 00:13:46.076 07:11:48 -- nvmf/common.sh@296 -- # local -ga x722 00:13:46.076 07:11:48 -- nvmf/common.sh@297 -- # mlx=() 00:13:46.076 07:11:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:46.076 07:11:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:46.076 07:11:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:46.076 07:11:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:46.076 07:11:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:46.076 07:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:46.076 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:46.076 07:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:46.076 07:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:46.076 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:46.076 07:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:46.076 07:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:46.076 07:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:46.076 07:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:46.076 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:46.076 07:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:46.076 07:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:46.076 07:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:46.076 07:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:46.076 07:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:46.076 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:46.076 07:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:46.076 07:11:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:46.076 07:11:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:46.076 07:11:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:46.076 07:11:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:46.076 07:11:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:46.076 07:11:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:46.076 07:11:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:46.076 07:11:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:46.076 07:11:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:46.076 07:11:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:46.076 07:11:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:46.076 07:11:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:46.076 07:11:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:46.076 07:11:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:46.076 07:11:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:46.076 07:11:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:46.076 07:11:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:46.076 07:11:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:46.076 07:11:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:46.076 07:11:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:46.335 07:11:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:46.335 07:11:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:46.335 07:11:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:46.335 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:46.335 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:13:46.335 00:13:46.335 --- 10.0.0.2 ping statistics --- 00:13:46.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:46.335 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:13:46.335 07:11:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:46.335 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:46.335 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:13:46.335 00:13:46.335 --- 10.0.0.1 ping statistics --- 00:13:46.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:46.335 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:13:46.335 07:11:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:46.335 07:11:49 -- nvmf/common.sh@410 -- # return 0 00:13:46.335 07:11:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:46.335 07:11:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:46.335 07:11:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:46.335 07:11:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:46.335 07:11:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:46.335 07:11:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:46.335 07:11:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:46.335 07:11:49 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:46.335 07:11:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:46.335 07:11:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:46.335 07:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:46.335 07:11:49 -- nvmf/common.sh@469 -- # nvmfpid=1870312 00:13:46.335 07:11:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:46.335 07:11:49 -- nvmf/common.sh@470 -- # waitforlisten 1870312 00:13:46.335 07:11:49 -- common/autotest_common.sh@819 -- # '[' -z 1870312 ']' 00:13:46.335 07:11:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:46.335 07:11:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:46.335 07:11:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:46.335 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:46.335 07:11:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:46.335 07:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:46.335 [2024-10-16 07:11:49.130046] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:46.335 [2024-10-16 07:11:49.130135] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:46.335 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.335 [2024-10-16 07:11:49.199858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:46.593 [2024-10-16 07:11:49.322290] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:46.593 [2024-10-16 07:11:49.322449] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:46.593 [2024-10-16 07:11:49.322468] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:46.593 [2024-10-16 07:11:49.322483] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:46.593 [2024-10-16 07:11:49.322523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:47.528 07:11:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:47.528 07:11:50 -- common/autotest_common.sh@852 -- # return 0 00:13:47.528 07:11:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:47.528 07:11:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 07:11:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:47.528 07:11:50 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 [2024-10-16 07:11:50.164276] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 [2024-10-16 07:11:50.180483] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 NULL1 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:47.528 07:11:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:47.528 07:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:47.528 07:11:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:47.528 07:11:50 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:47.528 [2024-10-16 07:11:50.224968] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:47.528 [2024-10-16 07:11:50.225005] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1870470 ] 00:13:47.528 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.786 Attached to nqn.2016-06.io.spdk:cnode1 00:13:47.786 Namespace ID: 1 size: 1GB 00:13:47.786 fused_ordering(0) 00:13:47.786 fused_ordering(1) 00:13:47.786 fused_ordering(2) 00:13:47.786 fused_ordering(3) 00:13:47.786 fused_ordering(4) 00:13:47.786 fused_ordering(5) 00:13:47.786 fused_ordering(6) 00:13:47.786 fused_ordering(7) 00:13:47.786 fused_ordering(8) 00:13:47.786 fused_ordering(9) 00:13:47.786 fused_ordering(10) 00:13:47.786 fused_ordering(11) 00:13:47.786 fused_ordering(12) 00:13:47.786 fused_ordering(13) 00:13:47.786 fused_ordering(14) 00:13:47.786 fused_ordering(15) 00:13:47.786 fused_ordering(16) 00:13:47.786 fused_ordering(17) 00:13:47.786 fused_ordering(18) 00:13:47.786 fused_ordering(19) 00:13:47.786 fused_ordering(20) 00:13:47.786 fused_ordering(21) 00:13:47.786 fused_ordering(22) 00:13:47.786 fused_ordering(23) 00:13:47.786 fused_ordering(24) 00:13:47.786 fused_ordering(25) 00:13:47.786 fused_ordering(26) 00:13:47.786 fused_ordering(27) 00:13:47.786 fused_ordering(28) 00:13:47.786 fused_ordering(29) 00:13:47.786 fused_ordering(30) 00:13:47.786 fused_ordering(31) 00:13:47.786 fused_ordering(32) 00:13:47.786 fused_ordering(33) 00:13:47.786 fused_ordering(34) 00:13:47.786 fused_ordering(35) 00:13:47.786 fused_ordering(36) 00:13:47.786 fused_ordering(37) 00:13:47.786 fused_ordering(38) 00:13:47.786 fused_ordering(39) 00:13:47.786 fused_ordering(40) 00:13:47.786 fused_ordering(41) 00:13:47.786 fused_ordering(42) 00:13:47.786 fused_ordering(43) 00:13:47.786 fused_ordering(44) 00:13:47.786 fused_ordering(45) 00:13:47.786 fused_ordering(46) 00:13:47.787 fused_ordering(47) 00:13:47.787 fused_ordering(48) 00:13:47.787 fused_ordering(49) 00:13:47.787 fused_ordering(50) 00:13:47.787 fused_ordering(51) 00:13:47.787 fused_ordering(52) 00:13:47.787 fused_ordering(53) 00:13:47.787 fused_ordering(54) 00:13:47.787 fused_ordering(55) 00:13:47.787 fused_ordering(56) 00:13:47.787 fused_ordering(57) 00:13:47.787 fused_ordering(58) 00:13:47.787 fused_ordering(59) 00:13:47.787 fused_ordering(60) 00:13:47.787 fused_ordering(61) 00:13:47.787 fused_ordering(62) 00:13:47.787 fused_ordering(63) 00:13:47.787 fused_ordering(64) 00:13:47.787 fused_ordering(65) 00:13:47.787 fused_ordering(66) 00:13:47.787 fused_ordering(67) 00:13:47.787 fused_ordering(68) 00:13:47.787 fused_ordering(69) 00:13:47.787 fused_ordering(70) 00:13:47.787 fused_ordering(71) 00:13:47.787 fused_ordering(72) 00:13:47.787 fused_ordering(73) 00:13:47.787 fused_ordering(74) 00:13:47.787 fused_ordering(75) 00:13:47.787 fused_ordering(76) 00:13:47.787 fused_ordering(77) 00:13:47.787 fused_ordering(78) 00:13:47.787 fused_ordering(79) 00:13:47.787 fused_ordering(80) 00:13:47.787 fused_ordering(81) 00:13:47.787 fused_ordering(82) 00:13:47.787 fused_ordering(83) 00:13:47.787 fused_ordering(84) 00:13:47.787 fused_ordering(85) 00:13:47.787 fused_ordering(86) 00:13:47.787 fused_ordering(87) 00:13:47.787 fused_ordering(88) 00:13:47.787 fused_ordering(89) 00:13:47.787 fused_ordering(90) 00:13:47.787 fused_ordering(91) 00:13:47.787 fused_ordering(92) 00:13:47.787 fused_ordering(93) 00:13:47.787 fused_ordering(94) 00:13:47.787 fused_ordering(95) 00:13:47.787 fused_ordering(96) 00:13:47.787 fused_ordering(97) 00:13:47.787 fused_ordering(98) 00:13:47.787 fused_ordering(99) 00:13:47.787 fused_ordering(100) 00:13:47.787 fused_ordering(101) 00:13:47.787 fused_ordering(102) 00:13:47.787 fused_ordering(103) 00:13:47.787 fused_ordering(104) 00:13:47.787 fused_ordering(105) 00:13:47.787 fused_ordering(106) 00:13:47.787 fused_ordering(107) 00:13:47.787 fused_ordering(108) 00:13:47.787 fused_ordering(109) 00:13:47.787 fused_ordering(110) 00:13:47.787 fused_ordering(111) 00:13:47.787 fused_ordering(112) 00:13:47.787 fused_ordering(113) 00:13:47.787 fused_ordering(114) 00:13:47.787 fused_ordering(115) 00:13:47.787 fused_ordering(116) 00:13:47.787 fused_ordering(117) 00:13:47.787 fused_ordering(118) 00:13:47.787 fused_ordering(119) 00:13:47.787 fused_ordering(120) 00:13:47.787 fused_ordering(121) 00:13:47.787 fused_ordering(122) 00:13:47.787 fused_ordering(123) 00:13:47.787 fused_ordering(124) 00:13:47.787 fused_ordering(125) 00:13:47.787 fused_ordering(126) 00:13:47.787 fused_ordering(127) 00:13:47.787 fused_ordering(128) 00:13:47.787 fused_ordering(129) 00:13:47.787 fused_ordering(130) 00:13:47.787 fused_ordering(131) 00:13:47.787 fused_ordering(132) 00:13:47.787 fused_ordering(133) 00:13:47.787 fused_ordering(134) 00:13:47.787 fused_ordering(135) 00:13:47.787 fused_ordering(136) 00:13:47.787 fused_ordering(137) 00:13:47.787 fused_ordering(138) 00:13:47.787 fused_ordering(139) 00:13:47.787 fused_ordering(140) 00:13:47.787 fused_ordering(141) 00:13:47.787 fused_ordering(142) 00:13:47.787 fused_ordering(143) 00:13:47.787 fused_ordering(144) 00:13:47.787 fused_ordering(145) 00:13:47.787 fused_ordering(146) 00:13:47.787 fused_ordering(147) 00:13:47.787 fused_ordering(148) 00:13:47.787 fused_ordering(149) 00:13:47.787 fused_ordering(150) 00:13:47.787 fused_ordering(151) 00:13:47.787 fused_ordering(152) 00:13:47.787 fused_ordering(153) 00:13:47.787 fused_ordering(154) 00:13:47.787 fused_ordering(155) 00:13:47.787 fused_ordering(156) 00:13:47.787 fused_ordering(157) 00:13:47.787 fused_ordering(158) 00:13:47.787 fused_ordering(159) 00:13:47.787 fused_ordering(160) 00:13:47.787 fused_ordering(161) 00:13:47.787 fused_ordering(162) 00:13:47.787 fused_ordering(163) 00:13:47.787 fused_ordering(164) 00:13:47.787 fused_ordering(165) 00:13:47.787 fused_ordering(166) 00:13:47.787 fused_ordering(167) 00:13:47.787 fused_ordering(168) 00:13:47.787 fused_ordering(169) 00:13:47.787 fused_ordering(170) 00:13:47.787 fused_ordering(171) 00:13:47.787 fused_ordering(172) 00:13:47.787 fused_ordering(173) 00:13:47.787 fused_ordering(174) 00:13:47.787 fused_ordering(175) 00:13:47.787 fused_ordering(176) 00:13:47.787 fused_ordering(177) 00:13:47.787 fused_ordering(178) 00:13:47.787 fused_ordering(179) 00:13:47.787 fused_ordering(180) 00:13:47.787 fused_ordering(181) 00:13:47.787 fused_ordering(182) 00:13:47.787 fused_ordering(183) 00:13:47.787 fused_ordering(184) 00:13:47.787 fused_ordering(185) 00:13:47.787 fused_ordering(186) 00:13:47.787 fused_ordering(187) 00:13:47.787 fused_ordering(188) 00:13:47.787 fused_ordering(189) 00:13:47.787 fused_ordering(190) 00:13:47.787 fused_ordering(191) 00:13:47.787 fused_ordering(192) 00:13:47.787 fused_ordering(193) 00:13:47.787 fused_ordering(194) 00:13:47.787 fused_ordering(195) 00:13:47.787 fused_ordering(196) 00:13:47.787 fused_ordering(197) 00:13:47.787 fused_ordering(198) 00:13:47.787 fused_ordering(199) 00:13:47.787 fused_ordering(200) 00:13:47.787 fused_ordering(201) 00:13:47.787 fused_ordering(202) 00:13:47.787 fused_ordering(203) 00:13:47.787 fused_ordering(204) 00:13:47.787 fused_ordering(205) 00:13:48.045 fused_ordering(206) 00:13:48.045 fused_ordering(207) 00:13:48.045 fused_ordering(208) 00:13:48.045 fused_ordering(209) 00:13:48.045 fused_ordering(210) 00:13:48.045 fused_ordering(211) 00:13:48.045 fused_ordering(212) 00:13:48.045 fused_ordering(213) 00:13:48.045 fused_ordering(214) 00:13:48.045 fused_ordering(215) 00:13:48.045 fused_ordering(216) 00:13:48.045 fused_ordering(217) 00:13:48.045 fused_ordering(218) 00:13:48.045 fused_ordering(219) 00:13:48.045 fused_ordering(220) 00:13:48.045 fused_ordering(221) 00:13:48.045 fused_ordering(222) 00:13:48.045 fused_ordering(223) 00:13:48.045 fused_ordering(224) 00:13:48.045 fused_ordering(225) 00:13:48.045 fused_ordering(226) 00:13:48.045 fused_ordering(227) 00:13:48.045 fused_ordering(228) 00:13:48.045 fused_ordering(229) 00:13:48.045 fused_ordering(230) 00:13:48.045 fused_ordering(231) 00:13:48.045 fused_ordering(232) 00:13:48.045 fused_ordering(233) 00:13:48.045 fused_ordering(234) 00:13:48.045 fused_ordering(235) 00:13:48.045 fused_ordering(236) 00:13:48.045 fused_ordering(237) 00:13:48.045 fused_ordering(238) 00:13:48.045 fused_ordering(239) 00:13:48.045 fused_ordering(240) 00:13:48.045 fused_ordering(241) 00:13:48.045 fused_ordering(242) 00:13:48.045 fused_ordering(243) 00:13:48.045 fused_ordering(244) 00:13:48.045 fused_ordering(245) 00:13:48.045 fused_ordering(246) 00:13:48.045 fused_ordering(247) 00:13:48.045 fused_ordering(248) 00:13:48.045 fused_ordering(249) 00:13:48.045 fused_ordering(250) 00:13:48.045 fused_ordering(251) 00:13:48.045 fused_ordering(252) 00:13:48.045 fused_ordering(253) 00:13:48.045 fused_ordering(254) 00:13:48.045 fused_ordering(255) 00:13:48.045 fused_ordering(256) 00:13:48.045 fused_ordering(257) 00:13:48.045 fused_ordering(258) 00:13:48.045 fused_ordering(259) 00:13:48.045 fused_ordering(260) 00:13:48.045 fused_ordering(261) 00:13:48.045 fused_ordering(262) 00:13:48.045 fused_ordering(263) 00:13:48.045 fused_ordering(264) 00:13:48.045 fused_ordering(265) 00:13:48.045 fused_ordering(266) 00:13:48.045 fused_ordering(267) 00:13:48.045 fused_ordering(268) 00:13:48.045 fused_ordering(269) 00:13:48.045 fused_ordering(270) 00:13:48.045 fused_ordering(271) 00:13:48.045 fused_ordering(272) 00:13:48.045 fused_ordering(273) 00:13:48.045 fused_ordering(274) 00:13:48.045 fused_ordering(275) 00:13:48.045 fused_ordering(276) 00:13:48.045 fused_ordering(277) 00:13:48.045 fused_ordering(278) 00:13:48.045 fused_ordering(279) 00:13:48.045 fused_ordering(280) 00:13:48.045 fused_ordering(281) 00:13:48.045 fused_ordering(282) 00:13:48.045 fused_ordering(283) 00:13:48.045 fused_ordering(284) 00:13:48.045 fused_ordering(285) 00:13:48.045 fused_ordering(286) 00:13:48.045 fused_ordering(287) 00:13:48.045 fused_ordering(288) 00:13:48.045 fused_ordering(289) 00:13:48.045 fused_ordering(290) 00:13:48.045 fused_ordering(291) 00:13:48.045 fused_ordering(292) 00:13:48.045 fused_ordering(293) 00:13:48.045 fused_ordering(294) 00:13:48.045 fused_ordering(295) 00:13:48.045 fused_ordering(296) 00:13:48.045 fused_ordering(297) 00:13:48.045 fused_ordering(298) 00:13:48.045 fused_ordering(299) 00:13:48.045 fused_ordering(300) 00:13:48.045 fused_ordering(301) 00:13:48.045 fused_ordering(302) 00:13:48.045 fused_ordering(303) 00:13:48.045 fused_ordering(304) 00:13:48.045 fused_ordering(305) 00:13:48.045 fused_ordering(306) 00:13:48.045 fused_ordering(307) 00:13:48.045 fused_ordering(308) 00:13:48.045 fused_ordering(309) 00:13:48.045 fused_ordering(310) 00:13:48.045 fused_ordering(311) 00:13:48.045 fused_ordering(312) 00:13:48.045 fused_ordering(313) 00:13:48.045 fused_ordering(314) 00:13:48.045 fused_ordering(315) 00:13:48.045 fused_ordering(316) 00:13:48.045 fused_ordering(317) 00:13:48.045 fused_ordering(318) 00:13:48.045 fused_ordering(319) 00:13:48.045 fused_ordering(320) 00:13:48.045 fused_ordering(321) 00:13:48.045 fused_ordering(322) 00:13:48.045 fused_ordering(323) 00:13:48.045 fused_ordering(324) 00:13:48.045 fused_ordering(325) 00:13:48.045 fused_ordering(326) 00:13:48.045 fused_ordering(327) 00:13:48.045 fused_ordering(328) 00:13:48.045 fused_ordering(329) 00:13:48.045 fused_ordering(330) 00:13:48.045 fused_ordering(331) 00:13:48.045 fused_ordering(332) 00:13:48.045 fused_ordering(333) 00:13:48.045 fused_ordering(334) 00:13:48.045 fused_ordering(335) 00:13:48.045 fused_ordering(336) 00:13:48.045 fused_ordering(337) 00:13:48.045 fused_ordering(338) 00:13:48.045 fused_ordering(339) 00:13:48.045 fused_ordering(340) 00:13:48.045 fused_ordering(341) 00:13:48.045 fused_ordering(342) 00:13:48.045 fused_ordering(343) 00:13:48.045 fused_ordering(344) 00:13:48.045 fused_ordering(345) 00:13:48.045 fused_ordering(346) 00:13:48.045 fused_ordering(347) 00:13:48.045 fused_ordering(348) 00:13:48.045 fused_ordering(349) 00:13:48.045 fused_ordering(350) 00:13:48.045 fused_ordering(351) 00:13:48.045 fused_ordering(352) 00:13:48.045 fused_ordering(353) 00:13:48.045 fused_ordering(354) 00:13:48.045 fused_ordering(355) 00:13:48.045 fused_ordering(356) 00:13:48.045 fused_ordering(357) 00:13:48.045 fused_ordering(358) 00:13:48.045 fused_ordering(359) 00:13:48.045 fused_ordering(360) 00:13:48.045 fused_ordering(361) 00:13:48.045 fused_ordering(362) 00:13:48.046 fused_ordering(363) 00:13:48.046 fused_ordering(364) 00:13:48.046 fused_ordering(365) 00:13:48.046 fused_ordering(366) 00:13:48.046 fused_ordering(367) 00:13:48.046 fused_ordering(368) 00:13:48.046 fused_ordering(369) 00:13:48.046 fused_ordering(370) 00:13:48.046 fused_ordering(371) 00:13:48.046 fused_ordering(372) 00:13:48.046 fused_ordering(373) 00:13:48.046 fused_ordering(374) 00:13:48.046 fused_ordering(375) 00:13:48.046 fused_ordering(376) 00:13:48.046 fused_ordering(377) 00:13:48.046 fused_ordering(378) 00:13:48.046 fused_ordering(379) 00:13:48.046 fused_ordering(380) 00:13:48.046 fused_ordering(381) 00:13:48.046 fused_ordering(382) 00:13:48.046 fused_ordering(383) 00:13:48.046 fused_ordering(384) 00:13:48.046 fused_ordering(385) 00:13:48.046 fused_ordering(386) 00:13:48.046 fused_ordering(387) 00:13:48.046 fused_ordering(388) 00:13:48.046 fused_ordering(389) 00:13:48.046 fused_ordering(390) 00:13:48.046 fused_ordering(391) 00:13:48.046 fused_ordering(392) 00:13:48.046 fused_ordering(393) 00:13:48.046 fused_ordering(394) 00:13:48.046 fused_ordering(395) 00:13:48.046 fused_ordering(396) 00:13:48.046 fused_ordering(397) 00:13:48.046 fused_ordering(398) 00:13:48.046 fused_ordering(399) 00:13:48.046 fused_ordering(400) 00:13:48.046 fused_ordering(401) 00:13:48.046 fused_ordering(402) 00:13:48.046 fused_ordering(403) 00:13:48.046 fused_ordering(404) 00:13:48.046 fused_ordering(405) 00:13:48.046 fused_ordering(406) 00:13:48.046 fused_ordering(407) 00:13:48.046 fused_ordering(408) 00:13:48.046 fused_ordering(409) 00:13:48.046 fused_ordering(410) 00:13:48.611 fused_ordering(411) 00:13:48.611 fused_ordering(412) 00:13:48.611 fused_ordering(413) 00:13:48.611 fused_ordering(414) 00:13:48.611 fused_ordering(415) 00:13:48.611 fused_ordering(416) 00:13:48.611 fused_ordering(417) 00:13:48.611 fused_ordering(418) 00:13:48.611 fused_ordering(419) 00:13:48.611 fused_ordering(420) 00:13:48.611 fused_ordering(421) 00:13:48.611 fused_ordering(422) 00:13:48.611 fused_ordering(423) 00:13:48.611 fused_ordering(424) 00:13:48.611 fused_ordering(425) 00:13:48.611 fused_ordering(426) 00:13:48.611 fused_ordering(427) 00:13:48.611 fused_ordering(428) 00:13:48.611 fused_ordering(429) 00:13:48.611 fused_ordering(430) 00:13:48.611 fused_ordering(431) 00:13:48.611 fused_ordering(432) 00:13:48.611 fused_ordering(433) 00:13:48.611 fused_ordering(434) 00:13:48.611 fused_ordering(435) 00:13:48.611 fused_ordering(436) 00:13:48.611 fused_ordering(437) 00:13:48.611 fused_ordering(438) 00:13:48.611 fused_ordering(439) 00:13:48.611 fused_ordering(440) 00:13:48.611 fused_ordering(441) 00:13:48.611 fused_ordering(442) 00:13:48.611 fused_ordering(443) 00:13:48.611 fused_ordering(444) 00:13:48.611 fused_ordering(445) 00:13:48.611 fused_ordering(446) 00:13:48.611 fused_ordering(447) 00:13:48.611 fused_ordering(448) 00:13:48.611 fused_ordering(449) 00:13:48.611 fused_ordering(450) 00:13:48.611 fused_ordering(451) 00:13:48.611 fused_ordering(452) 00:13:48.611 fused_ordering(453) 00:13:48.611 fused_ordering(454) 00:13:48.611 fused_ordering(455) 00:13:48.611 fused_ordering(456) 00:13:48.611 fused_ordering(457) 00:13:48.611 fused_ordering(458) 00:13:48.611 fused_ordering(459) 00:13:48.611 fused_ordering(460) 00:13:48.611 fused_ordering(461) 00:13:48.611 fused_ordering(462) 00:13:48.611 fused_ordering(463) 00:13:48.611 fused_ordering(464) 00:13:48.611 fused_ordering(465) 00:13:48.611 fused_ordering(466) 00:13:48.611 fused_ordering(467) 00:13:48.611 fused_ordering(468) 00:13:48.611 fused_ordering(469) 00:13:48.611 fused_ordering(470) 00:13:48.611 fused_ordering(471) 00:13:48.611 fused_ordering(472) 00:13:48.611 fused_ordering(473) 00:13:48.611 fused_ordering(474) 00:13:48.611 fused_ordering(475) 00:13:48.611 fused_ordering(476) 00:13:48.611 fused_ordering(477) 00:13:48.611 fused_ordering(478) 00:13:48.611 fused_ordering(479) 00:13:48.611 fused_ordering(480) 00:13:48.611 fused_ordering(481) 00:13:48.611 fused_ordering(482) 00:13:48.611 fused_ordering(483) 00:13:48.611 fused_ordering(484) 00:13:48.611 fused_ordering(485) 00:13:48.611 fused_ordering(486) 00:13:48.611 fused_ordering(487) 00:13:48.611 fused_ordering(488) 00:13:48.611 fused_ordering(489) 00:13:48.611 fused_ordering(490) 00:13:48.611 fused_ordering(491) 00:13:48.611 fused_ordering(492) 00:13:48.611 fused_ordering(493) 00:13:48.611 fused_ordering(494) 00:13:48.611 fused_ordering(495) 00:13:48.611 fused_ordering(496) 00:13:48.611 fused_ordering(497) 00:13:48.611 fused_ordering(498) 00:13:48.611 fused_ordering(499) 00:13:48.611 fused_ordering(500) 00:13:48.611 fused_ordering(501) 00:13:48.611 fused_ordering(502) 00:13:48.611 fused_ordering(503) 00:13:48.611 fused_ordering(504) 00:13:48.611 fused_ordering(505) 00:13:48.611 fused_ordering(506) 00:13:48.611 fused_ordering(507) 00:13:48.611 fused_ordering(508) 00:13:48.611 fused_ordering(509) 00:13:48.611 fused_ordering(510) 00:13:48.611 fused_ordering(511) 00:13:48.611 fused_ordering(512) 00:13:48.611 fused_ordering(513) 00:13:48.611 fused_ordering(514) 00:13:48.611 fused_ordering(515) 00:13:48.611 fused_ordering(516) 00:13:48.611 fused_ordering(517) 00:13:48.611 fused_ordering(518) 00:13:48.611 fused_ordering(519) 00:13:48.611 fused_ordering(520) 00:13:48.611 fused_ordering(521) 00:13:48.611 fused_ordering(522) 00:13:48.611 fused_ordering(523) 00:13:48.611 fused_ordering(524) 00:13:48.611 fused_ordering(525) 00:13:48.611 fused_ordering(526) 00:13:48.611 fused_ordering(527) 00:13:48.611 fused_ordering(528) 00:13:48.611 fused_ordering(529) 00:13:48.611 fused_ordering(530) 00:13:48.611 fused_ordering(531) 00:13:48.611 fused_ordering(532) 00:13:48.611 fused_ordering(533) 00:13:48.611 fused_ordering(534) 00:13:48.611 fused_ordering(535) 00:13:48.611 fused_ordering(536) 00:13:48.611 fused_ordering(537) 00:13:48.611 fused_ordering(538) 00:13:48.611 fused_ordering(539) 00:13:48.611 fused_ordering(540) 00:13:48.611 fused_ordering(541) 00:13:48.611 fused_ordering(542) 00:13:48.611 fused_ordering(543) 00:13:48.611 fused_ordering(544) 00:13:48.611 fused_ordering(545) 00:13:48.611 fused_ordering(546) 00:13:48.611 fused_ordering(547) 00:13:48.611 fused_ordering(548) 00:13:48.611 fused_ordering(549) 00:13:48.611 fused_ordering(550) 00:13:48.611 fused_ordering(551) 00:13:48.611 fused_ordering(552) 00:13:48.611 fused_ordering(553) 00:13:48.611 fused_ordering(554) 00:13:48.611 fused_ordering(555) 00:13:48.611 fused_ordering(556) 00:13:48.611 fused_ordering(557) 00:13:48.611 fused_ordering(558) 00:13:48.611 fused_ordering(559) 00:13:48.611 fused_ordering(560) 00:13:48.611 fused_ordering(561) 00:13:48.611 fused_ordering(562) 00:13:48.612 fused_ordering(563) 00:13:48.612 fused_ordering(564) 00:13:48.612 fused_ordering(565) 00:13:48.612 fused_ordering(566) 00:13:48.612 fused_ordering(567) 00:13:48.612 fused_ordering(568) 00:13:48.612 fused_ordering(569) 00:13:48.612 fused_ordering(570) 00:13:48.612 fused_ordering(571) 00:13:48.612 fused_ordering(572) 00:13:48.612 fused_ordering(573) 00:13:48.612 fused_ordering(574) 00:13:48.612 fused_ordering(575) 00:13:48.612 fused_ordering(576) 00:13:48.612 fused_ordering(577) 00:13:48.612 fused_ordering(578) 00:13:48.612 fused_ordering(579) 00:13:48.612 fused_ordering(580) 00:13:48.612 fused_ordering(581) 00:13:48.612 fused_ordering(582) 00:13:48.612 fused_ordering(583) 00:13:48.612 fused_ordering(584) 00:13:48.612 fused_ordering(585) 00:13:48.612 fused_ordering(586) 00:13:48.612 fused_ordering(587) 00:13:48.612 fused_ordering(588) 00:13:48.612 fused_ordering(589) 00:13:48.612 fused_ordering(590) 00:13:48.612 fused_ordering(591) 00:13:48.612 fused_ordering(592) 00:13:48.612 fused_ordering(593) 00:13:48.612 fused_ordering(594) 00:13:48.612 fused_ordering(595) 00:13:48.612 fused_ordering(596) 00:13:48.612 fused_ordering(597) 00:13:48.612 fused_ordering(598) 00:13:48.612 fused_ordering(599) 00:13:48.612 fused_ordering(600) 00:13:48.612 fused_ordering(601) 00:13:48.612 fused_ordering(602) 00:13:48.612 fused_ordering(603) 00:13:48.612 fused_ordering(604) 00:13:48.612 fused_ordering(605) 00:13:48.612 fused_ordering(606) 00:13:48.612 fused_ordering(607) 00:13:48.612 fused_ordering(608) 00:13:48.612 fused_ordering(609) 00:13:48.612 fused_ordering(610) 00:13:48.612 fused_ordering(611) 00:13:48.612 fused_ordering(612) 00:13:48.612 fused_ordering(613) 00:13:48.612 fused_ordering(614) 00:13:48.612 fused_ordering(615) 00:13:49.178 fused_ordering(616) 00:13:49.178 fused_ordering(617) 00:13:49.178 fused_ordering(618) 00:13:49.178 fused_ordering(619) 00:13:49.178 fused_ordering(620) 00:13:49.178 fused_ordering(621) 00:13:49.178 fused_ordering(622) 00:13:49.178 fused_ordering(623) 00:13:49.178 fused_ordering(624) 00:13:49.178 fused_ordering(625) 00:13:49.178 fused_ordering(626) 00:13:49.178 fused_ordering(627) 00:13:49.178 fused_ordering(628) 00:13:49.178 fused_ordering(629) 00:13:49.178 fused_ordering(630) 00:13:49.178 fused_ordering(631) 00:13:49.178 fused_ordering(632) 00:13:49.178 fused_ordering(633) 00:13:49.178 fused_ordering(634) 00:13:49.178 fused_ordering(635) 00:13:49.178 fused_ordering(636) 00:13:49.178 fused_ordering(637) 00:13:49.178 fused_ordering(638) 00:13:49.178 fused_ordering(639) 00:13:49.178 fused_ordering(640) 00:13:49.178 fused_ordering(641) 00:13:49.178 fused_ordering(642) 00:13:49.178 fused_ordering(643) 00:13:49.178 fused_ordering(644) 00:13:49.178 fused_ordering(645) 00:13:49.178 fused_ordering(646) 00:13:49.178 fused_ordering(647) 00:13:49.178 fused_ordering(648) 00:13:49.178 fused_ordering(649) 00:13:49.178 fused_ordering(650) 00:13:49.178 fused_ordering(651) 00:13:49.178 fused_ordering(652) 00:13:49.178 fused_ordering(653) 00:13:49.178 fused_ordering(654) 00:13:49.178 fused_ordering(655) 00:13:49.178 fused_ordering(656) 00:13:49.178 fused_ordering(657) 00:13:49.178 fused_ordering(658) 00:13:49.178 fused_ordering(659) 00:13:49.178 fused_ordering(660) 00:13:49.178 fused_ordering(661) 00:13:49.178 fused_ordering(662) 00:13:49.178 fused_ordering(663) 00:13:49.178 fused_ordering(664) 00:13:49.178 fused_ordering(665) 00:13:49.178 fused_ordering(666) 00:13:49.178 fused_ordering(667) 00:13:49.178 fused_ordering(668) 00:13:49.178 fused_ordering(669) 00:13:49.178 fused_ordering(670) 00:13:49.178 fused_ordering(671) 00:13:49.178 fused_ordering(672) 00:13:49.178 fused_ordering(673) 00:13:49.178 fused_ordering(674) 00:13:49.178 fused_ordering(675) 00:13:49.178 fused_ordering(676) 00:13:49.178 fused_ordering(677) 00:13:49.178 fused_ordering(678) 00:13:49.178 fused_ordering(679) 00:13:49.178 fused_ordering(680) 00:13:49.178 fused_ordering(681) 00:13:49.178 fused_ordering(682) 00:13:49.178 fused_ordering(683) 00:13:49.178 fused_ordering(684) 00:13:49.178 fused_ordering(685) 00:13:49.178 fused_ordering(686) 00:13:49.178 fused_ordering(687) 00:13:49.178 fused_ordering(688) 00:13:49.178 fused_ordering(689) 00:13:49.178 fused_ordering(690) 00:13:49.178 fused_ordering(691) 00:13:49.178 fused_ordering(692) 00:13:49.178 fused_ordering(693) 00:13:49.178 fused_ordering(694) 00:13:49.178 fused_ordering(695) 00:13:49.178 fused_ordering(696) 00:13:49.178 fused_ordering(697) 00:13:49.178 fused_ordering(698) 00:13:49.178 fused_ordering(699) 00:13:49.178 fused_ordering(700) 00:13:49.178 fused_ordering(701) 00:13:49.178 fused_ordering(702) 00:13:49.178 fused_ordering(703) 00:13:49.178 fused_ordering(704) 00:13:49.178 fused_ordering(705) 00:13:49.178 fused_ordering(706) 00:13:49.178 fused_ordering(707) 00:13:49.178 fused_ordering(708) 00:13:49.178 fused_ordering(709) 00:13:49.178 fused_ordering(710) 00:13:49.178 fused_ordering(711) 00:13:49.178 fused_ordering(712) 00:13:49.178 fused_ordering(713) 00:13:49.178 fused_ordering(714) 00:13:49.178 fused_ordering(715) 00:13:49.178 fused_ordering(716) 00:13:49.178 fused_ordering(717) 00:13:49.178 fused_ordering(718) 00:13:49.178 fused_ordering(719) 00:13:49.178 fused_ordering(720) 00:13:49.178 fused_ordering(721) 00:13:49.178 fused_ordering(722) 00:13:49.178 fused_ordering(723) 00:13:49.178 fused_ordering(724) 00:13:49.178 fused_ordering(725) 00:13:49.178 fused_ordering(726) 00:13:49.178 fused_ordering(727) 00:13:49.178 fused_ordering(728) 00:13:49.178 fused_ordering(729) 00:13:49.178 fused_ordering(730) 00:13:49.178 fused_ordering(731) 00:13:49.178 fused_ordering(732) 00:13:49.178 fused_ordering(733) 00:13:49.178 fused_ordering(734) 00:13:49.178 fused_ordering(735) 00:13:49.178 fused_ordering(736) 00:13:49.178 fused_ordering(737) 00:13:49.178 fused_ordering(738) 00:13:49.178 fused_ordering(739) 00:13:49.178 fused_ordering(740) 00:13:49.178 fused_ordering(741) 00:13:49.178 fused_ordering(742) 00:13:49.178 fused_ordering(743) 00:13:49.178 fused_ordering(744) 00:13:49.178 fused_ordering(745) 00:13:49.179 fused_ordering(746) 00:13:49.179 fused_ordering(747) 00:13:49.179 fused_ordering(748) 00:13:49.179 fused_ordering(749) 00:13:49.179 fused_ordering(750) 00:13:49.179 fused_ordering(751) 00:13:49.179 fused_ordering(752) 00:13:49.179 fused_ordering(753) 00:13:49.179 fused_ordering(754) 00:13:49.179 fused_ordering(755) 00:13:49.179 fused_ordering(756) 00:13:49.179 fused_ordering(757) 00:13:49.179 fused_ordering(758) 00:13:49.179 fused_ordering(759) 00:13:49.179 fused_ordering(760) 00:13:49.179 fused_ordering(761) 00:13:49.179 fused_ordering(762) 00:13:49.179 fused_ordering(763) 00:13:49.179 fused_ordering(764) 00:13:49.179 fused_ordering(765) 00:13:49.179 fused_ordering(766) 00:13:49.179 fused_ordering(767) 00:13:49.179 fused_ordering(768) 00:13:49.179 fused_ordering(769) 00:13:49.179 fused_ordering(770) 00:13:49.179 fused_ordering(771) 00:13:49.179 fused_ordering(772) 00:13:49.179 fused_ordering(773) 00:13:49.179 fused_ordering(774) 00:13:49.179 fused_ordering(775) 00:13:49.179 fused_ordering(776) 00:13:49.179 fused_ordering(777) 00:13:49.179 fused_ordering(778) 00:13:49.179 fused_ordering(779) 00:13:49.179 fused_ordering(780) 00:13:49.179 fused_ordering(781) 00:13:49.179 fused_ordering(782) 00:13:49.179 fused_ordering(783) 00:13:49.179 fused_ordering(784) 00:13:49.179 fused_ordering(785) 00:13:49.179 fused_ordering(786) 00:13:49.179 fused_ordering(787) 00:13:49.179 fused_ordering(788) 00:13:49.179 fused_ordering(789) 00:13:49.179 fused_ordering(790) 00:13:49.179 fused_ordering(791) 00:13:49.179 fused_ordering(792) 00:13:49.179 fused_ordering(793) 00:13:49.179 fused_ordering(794) 00:13:49.179 fused_ordering(795) 00:13:49.179 fused_ordering(796) 00:13:49.179 fused_ordering(797) 00:13:49.179 fused_ordering(798) 00:13:49.179 fused_ordering(799) 00:13:49.179 fused_ordering(800) 00:13:49.179 fused_ordering(801) 00:13:49.179 fused_ordering(802) 00:13:49.179 fused_ordering(803) 00:13:49.179 fused_ordering(804) 00:13:49.179 fused_ordering(805) 00:13:49.179 fused_ordering(806) 00:13:49.179 fused_ordering(807) 00:13:49.179 fused_ordering(808) 00:13:49.179 fused_ordering(809) 00:13:49.179 fused_ordering(810) 00:13:49.179 fused_ordering(811) 00:13:49.179 fused_ordering(812) 00:13:49.179 fused_ordering(813) 00:13:49.179 fused_ordering(814) 00:13:49.179 fused_ordering(815) 00:13:49.179 fused_ordering(816) 00:13:49.179 fused_ordering(817) 00:13:49.179 fused_ordering(818) 00:13:49.179 fused_ordering(819) 00:13:49.179 fused_ordering(820) 00:13:50.112 fused_ordering(821) 00:13:50.112 fused_ordering(822) 00:13:50.112 fused_ordering(823) 00:13:50.112 fused_ordering(824) 00:13:50.112 fused_ordering(825) 00:13:50.112 fused_ordering(826) 00:13:50.112 fused_ordering(827) 00:13:50.112 fused_ordering(828) 00:13:50.112 fused_ordering(829) 00:13:50.112 fused_ordering(830) 00:13:50.112 fused_ordering(831) 00:13:50.112 fused_ordering(832) 00:13:50.112 fused_ordering(833) 00:13:50.112 fused_ordering(834) 00:13:50.112 fused_ordering(835) 00:13:50.112 fused_ordering(836) 00:13:50.112 fused_ordering(837) 00:13:50.112 fused_ordering(838) 00:13:50.112 fused_ordering(839) 00:13:50.112 fused_ordering(840) 00:13:50.112 fused_ordering(841) 00:13:50.112 fused_ordering(842) 00:13:50.112 fused_ordering(843) 00:13:50.112 fused_ordering(844) 00:13:50.112 fused_ordering(845) 00:13:50.112 fused_ordering(846) 00:13:50.112 fused_ordering(847) 00:13:50.112 fused_ordering(848) 00:13:50.112 fused_ordering(849) 00:13:50.112 fused_ordering(850) 00:13:50.112 fused_ordering(851) 00:13:50.112 fused_ordering(852) 00:13:50.112 fused_ordering(853) 00:13:50.112 fused_ordering(854) 00:13:50.112 fused_ordering(855) 00:13:50.112 fused_ordering(856) 00:13:50.112 fused_ordering(857) 00:13:50.112 fused_ordering(858) 00:13:50.112 fused_ordering(859) 00:13:50.112 fused_ordering(860) 00:13:50.112 fused_ordering(861) 00:13:50.112 fused_ordering(862) 00:13:50.112 fused_ordering(863) 00:13:50.112 fused_ordering(864) 00:13:50.112 fused_ordering(865) 00:13:50.112 fused_ordering(866) 00:13:50.112 fused_ordering(867) 00:13:50.112 fused_ordering(868) 00:13:50.112 fused_ordering(869) 00:13:50.112 fused_ordering(870) 00:13:50.112 fused_ordering(871) 00:13:50.112 fused_ordering(872) 00:13:50.112 fused_ordering(873) 00:13:50.112 fused_ordering(874) 00:13:50.112 fused_ordering(875) 00:13:50.112 fused_ordering(876) 00:13:50.112 fused_ordering(877) 00:13:50.112 fused_ordering(878) 00:13:50.112 fused_ordering(879) 00:13:50.112 fused_ordering(880) 00:13:50.112 fused_ordering(881) 00:13:50.112 fused_ordering(882) 00:13:50.112 fused_ordering(883) 00:13:50.112 fused_ordering(884) 00:13:50.112 fused_ordering(885) 00:13:50.112 fused_ordering(886) 00:13:50.112 fused_ordering(887) 00:13:50.112 fused_ordering(888) 00:13:50.112 fused_ordering(889) 00:13:50.112 fused_ordering(890) 00:13:50.112 fused_ordering(891) 00:13:50.112 fused_ordering(892) 00:13:50.112 fused_ordering(893) 00:13:50.112 fused_ordering(894) 00:13:50.112 fused_ordering(895) 00:13:50.112 fused_ordering(896) 00:13:50.112 fused_ordering(897) 00:13:50.112 fused_ordering(898) 00:13:50.112 fused_ordering(899) 00:13:50.112 fused_ordering(900) 00:13:50.112 fused_ordering(901) 00:13:50.112 fused_ordering(902) 00:13:50.112 fused_ordering(903) 00:13:50.112 fused_ordering(904) 00:13:50.112 fused_ordering(905) 00:13:50.112 fused_ordering(906) 00:13:50.112 fused_ordering(907) 00:13:50.112 fused_ordering(908) 00:13:50.112 fused_ordering(909) 00:13:50.112 fused_ordering(910) 00:13:50.112 fused_ordering(911) 00:13:50.112 fused_ordering(912) 00:13:50.112 fused_ordering(913) 00:13:50.112 fused_ordering(914) 00:13:50.112 fused_ordering(915) 00:13:50.112 fused_ordering(916) 00:13:50.112 fused_ordering(917) 00:13:50.112 fused_ordering(918) 00:13:50.112 fused_ordering(919) 00:13:50.112 fused_ordering(920) 00:13:50.112 fused_ordering(921) 00:13:50.112 fused_ordering(922) 00:13:50.112 fused_ordering(923) 00:13:50.112 fused_ordering(924) 00:13:50.112 fused_ordering(925) 00:13:50.112 fused_ordering(926) 00:13:50.112 fused_ordering(927) 00:13:50.112 fused_ordering(928) 00:13:50.112 fused_ordering(929) 00:13:50.112 fused_ordering(930) 00:13:50.112 fused_ordering(931) 00:13:50.112 fused_ordering(932) 00:13:50.112 fused_ordering(933) 00:13:50.112 fused_ordering(934) 00:13:50.112 fused_ordering(935) 00:13:50.112 fused_ordering(936) 00:13:50.112 fused_ordering(937) 00:13:50.112 fused_ordering(938) 00:13:50.112 fused_ordering(939) 00:13:50.112 fused_ordering(940) 00:13:50.112 fused_ordering(941) 00:13:50.112 fused_ordering(942) 00:13:50.112 fused_ordering(943) 00:13:50.112 fused_ordering(944) 00:13:50.112 fused_ordering(945) 00:13:50.112 fused_ordering(946) 00:13:50.112 fused_ordering(947) 00:13:50.112 fused_ordering(948) 00:13:50.112 fused_ordering(949) 00:13:50.112 fused_ordering(950) 00:13:50.112 fused_ordering(951) 00:13:50.112 fused_ordering(952) 00:13:50.112 fused_ordering(953) 00:13:50.112 fused_ordering(954) 00:13:50.112 fused_ordering(955) 00:13:50.112 fused_ordering(956) 00:13:50.112 fused_ordering(957) 00:13:50.112 fused_ordering(958) 00:13:50.112 fused_ordering(959) 00:13:50.112 fused_ordering(960) 00:13:50.112 fused_ordering(961) 00:13:50.112 fused_ordering(962) 00:13:50.112 fused_ordering(963) 00:13:50.112 fused_ordering(964) 00:13:50.112 fused_ordering(965) 00:13:50.112 fused_ordering(966) 00:13:50.112 fused_ordering(967) 00:13:50.112 fused_ordering(968) 00:13:50.112 fused_ordering(969) 00:13:50.112 fused_ordering(970) 00:13:50.112 fused_ordering(971) 00:13:50.112 fused_ordering(972) 00:13:50.112 fused_ordering(973) 00:13:50.112 fused_ordering(974) 00:13:50.112 fused_ordering(975) 00:13:50.112 fused_ordering(976) 00:13:50.112 fused_ordering(977) 00:13:50.112 fused_ordering(978) 00:13:50.112 fused_ordering(979) 00:13:50.112 fused_ordering(980) 00:13:50.112 fused_ordering(981) 00:13:50.112 fused_ordering(982) 00:13:50.112 fused_ordering(983) 00:13:50.112 fused_ordering(984) 00:13:50.112 fused_ordering(985) 00:13:50.112 fused_ordering(986) 00:13:50.112 fused_ordering(987) 00:13:50.113 fused_ordering(988) 00:13:50.113 fused_ordering(989) 00:13:50.113 fused_ordering(990) 00:13:50.113 fused_ordering(991) 00:13:50.113 fused_ordering(992) 00:13:50.113 fused_ordering(993) 00:13:50.113 fused_ordering(994) 00:13:50.113 fused_ordering(995) 00:13:50.113 fused_ordering(996) 00:13:50.113 fused_ordering(997) 00:13:50.113 fused_ordering(998) 00:13:50.113 fused_ordering(999) 00:13:50.113 fused_ordering(1000) 00:13:50.113 fused_ordering(1001) 00:13:50.113 fused_ordering(1002) 00:13:50.113 fused_ordering(1003) 00:13:50.113 fused_ordering(1004) 00:13:50.113 fused_ordering(1005) 00:13:50.113 fused_ordering(1006) 00:13:50.113 fused_ordering(1007) 00:13:50.113 fused_ordering(1008) 00:13:50.113 fused_ordering(1009) 00:13:50.113 fused_ordering(1010) 00:13:50.113 fused_ordering(1011) 00:13:50.113 fused_ordering(1012) 00:13:50.113 fused_ordering(1013) 00:13:50.113 fused_ordering(1014) 00:13:50.113 fused_ordering(1015) 00:13:50.113 fused_ordering(1016) 00:13:50.113 fused_ordering(1017) 00:13:50.113 fused_ordering(1018) 00:13:50.113 fused_ordering(1019) 00:13:50.113 fused_ordering(1020) 00:13:50.113 fused_ordering(1021) 00:13:50.113 fused_ordering(1022) 00:13:50.113 fused_ordering(1023) 00:13:50.113 07:11:52 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:50.113 07:11:52 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:50.113 07:11:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.113 07:11:52 -- nvmf/common.sh@116 -- # sync 00:13:50.113 07:11:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.113 07:11:52 -- nvmf/common.sh@119 -- # set +e 00:13:50.113 07:11:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.113 07:11:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.113 rmmod nvme_tcp 00:13:50.113 rmmod nvme_fabrics 00:13:50.113 rmmod nvme_keyring 00:13:50.113 07:11:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:50.113 07:11:52 -- nvmf/common.sh@123 -- # set -e 00:13:50.113 07:11:52 -- nvmf/common.sh@124 -- # return 0 00:13:50.113 07:11:52 -- nvmf/common.sh@477 -- # '[' -n 1870312 ']' 00:13:50.113 07:11:52 -- nvmf/common.sh@478 -- # killprocess 1870312 00:13:50.113 07:11:52 -- common/autotest_common.sh@926 -- # '[' -z 1870312 ']' 00:13:50.113 07:11:52 -- common/autotest_common.sh@930 -- # kill -0 1870312 00:13:50.113 07:11:52 -- common/autotest_common.sh@931 -- # uname 00:13:50.113 07:11:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:50.113 07:11:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1870312 00:13:50.113 07:11:52 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:50.113 07:11:52 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:50.113 07:11:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1870312' 00:13:50.113 killing process with pid 1870312 00:13:50.113 07:11:52 -- common/autotest_common.sh@945 -- # kill 1870312 00:13:50.113 07:11:52 -- common/autotest_common.sh@950 -- # wait 1870312 00:13:50.372 07:11:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:50.372 07:11:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:50.372 07:11:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:50.372 07:11:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.372 07:11:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:50.372 07:11:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.372 07:11:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.372 07:11:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.272 07:11:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:52.272 00:13:52.272 real 0m8.283s 00:13:52.272 user 0m6.104s 00:13:52.272 sys 0m3.272s 00:13:52.272 07:11:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:52.272 07:11:55 -- common/autotest_common.sh@10 -- # set +x 00:13:52.272 ************************************ 00:13:52.272 END TEST nvmf_fused_ordering 00:13:52.272 ************************************ 00:13:52.272 07:11:55 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:52.272 07:11:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:52.272 07:11:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:52.272 07:11:55 -- common/autotest_common.sh@10 -- # set +x 00:13:52.272 ************************************ 00:13:52.272 START TEST nvmf_delete_subsystem 00:13:52.272 ************************************ 00:13:52.272 07:11:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:52.272 * Looking for test storage... 00:13:52.272 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.272 07:11:55 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.272 07:11:55 -- nvmf/common.sh@7 -- # uname -s 00:13:52.272 07:11:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.272 07:11:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.272 07:11:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.272 07:11:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.272 07:11:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.272 07:11:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.272 07:11:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.272 07:11:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.272 07:11:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.272 07:11:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.531 07:11:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.531 07:11:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.531 07:11:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.531 07:11:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.531 07:11:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.531 07:11:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.531 07:11:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.531 07:11:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.531 07:11:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.531 07:11:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.531 07:11:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.531 07:11:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.531 07:11:55 -- paths/export.sh@5 -- # export PATH 00:13:52.531 07:11:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.531 07:11:55 -- nvmf/common.sh@46 -- # : 0 00:13:52.531 07:11:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:52.531 07:11:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:52.531 07:11:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:52.531 07:11:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.531 07:11:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.531 07:11:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:52.531 07:11:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:52.532 07:11:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:52.532 07:11:55 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:52.532 07:11:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:52.532 07:11:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.532 07:11:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:52.532 07:11:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:52.532 07:11:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:52.532 07:11:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.532 07:11:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.532 07:11:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.532 07:11:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:52.532 07:11:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:52.532 07:11:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:52.532 07:11:55 -- common/autotest_common.sh@10 -- # set +x 00:13:54.433 07:11:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:54.433 07:11:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:54.433 07:11:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:54.433 07:11:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:54.433 07:11:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:54.433 07:11:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:54.433 07:11:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:54.433 07:11:57 -- nvmf/common.sh@294 -- # net_devs=() 00:13:54.433 07:11:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:54.433 07:11:57 -- nvmf/common.sh@295 -- # e810=() 00:13:54.433 07:11:57 -- nvmf/common.sh@295 -- # local -ga e810 00:13:54.433 07:11:57 -- nvmf/common.sh@296 -- # x722=() 00:13:54.433 07:11:57 -- nvmf/common.sh@296 -- # local -ga x722 00:13:54.433 07:11:57 -- nvmf/common.sh@297 -- # mlx=() 00:13:54.433 07:11:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:54.433 07:11:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:54.433 07:11:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:54.433 07:11:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:54.433 07:11:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.433 07:11:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:54.433 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:54.433 07:11:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.433 07:11:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:54.433 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:54.433 07:11:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.433 07:11:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.433 07:11:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.433 07:11:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:54.433 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:54.433 07:11:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.433 07:11:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.433 07:11:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.433 07:11:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.433 07:11:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:54.433 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:54.433 07:11:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.433 07:11:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:54.433 07:11:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:54.433 07:11:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:54.433 07:11:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:54.433 07:11:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:54.433 07:11:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:54.433 07:11:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:54.433 07:11:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:54.433 07:11:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:54.433 07:11:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:54.433 07:11:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:54.433 07:11:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:54.433 07:11:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:54.433 07:11:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:54.433 07:11:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:54.433 07:11:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:54.433 07:11:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:54.433 07:11:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:54.433 07:11:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:54.433 07:11:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:54.695 07:11:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:54.695 07:11:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:54.695 07:11:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:54.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:54.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:13:54.695 00:13:54.695 --- 10.0.0.2 ping statistics --- 00:13:54.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.695 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:13:54.695 07:11:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:54.695 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:54.695 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:13:54.695 00:13:54.695 --- 10.0.0.1 ping statistics --- 00:13:54.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.695 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:13:54.695 07:11:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:54.695 07:11:57 -- nvmf/common.sh@410 -- # return 0 00:13:54.695 07:11:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:54.695 07:11:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:54.695 07:11:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:54.695 07:11:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:54.695 07:11:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:54.695 07:11:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:54.695 07:11:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:54.695 07:11:57 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:54.695 07:11:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:54.695 07:11:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:54.695 07:11:57 -- common/autotest_common.sh@10 -- # set +x 00:13:54.695 07:11:57 -- nvmf/common.sh@469 -- # nvmfpid=1872702 00:13:54.695 07:11:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:54.695 07:11:57 -- nvmf/common.sh@470 -- # waitforlisten 1872702 00:13:54.695 07:11:57 -- common/autotest_common.sh@819 -- # '[' -z 1872702 ']' 00:13:54.695 07:11:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:54.695 07:11:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:54.695 07:11:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:54.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:54.695 07:11:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:54.695 07:11:57 -- common/autotest_common.sh@10 -- # set +x 00:13:54.695 [2024-10-16 07:11:57.500297] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:54.695 [2024-10-16 07:11:57.500366] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.695 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.695 [2024-10-16 07:11:57.572988] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:54.952 [2024-10-16 07:11:57.689337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.952 [2024-10-16 07:11:57.689496] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.952 [2024-10-16 07:11:57.689516] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.952 [2024-10-16 07:11:57.689531] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.952 [2024-10-16 07:11:57.689589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.952 [2024-10-16 07:11:57.689596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.886 07:11:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:55.886 07:11:58 -- common/autotest_common.sh@852 -- # return 0 00:13:55.886 07:11:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.886 07:11:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 07:11:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 [2024-10-16 07:11:58.514050] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 [2024-10-16 07:11:58.530369] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 NULL1 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 Delay0 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.886 07:11:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.886 07:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:55.886 07:11:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@28 -- # perf_pid=1872854 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:55.886 07:11:58 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:55.886 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.886 [2024-10-16 07:11:58.604944] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:57.785 07:12:00 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:57.785 07:12:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:57.785 07:12:00 -- common/autotest_common.sh@10 -- # set +x 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 [2024-10-16 07:12:00.814158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x208f770 is same with the state(5) to be set 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 starting I/O failed: -6 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 [2024-10-16 07:12:00.815990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f489c000c00 is same with the state(5) to be set 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Write completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.044 Read completed with error (sct=0, sc=8) 00:13:58.978 [2024-10-16 07:12:01.784319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20a8960 is same with the state(5) to be set 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 [2024-10-16 07:12:01.815711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f489c00bf20 is same with the state(5) to be set 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 [2024-10-16 07:12:01.818797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20af3d0 is same with the state(5) to be set 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 [2024-10-16 07:12:01.819239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x208f4c0 is same with the state(5) to be set 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Write completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 Read completed with error (sct=0, sc=8) 00:13:58.978 [2024-10-16 07:12:01.819479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x208fa20 is same with the state(5) to be set 00:13:58.978 [2024-10-16 07:12:01.820416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20a8960 (9): Bad file descriptor 00:13:58.978 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:58.978 07:12:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:58.978 07:12:01 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:58.978 07:12:01 -- target/delete_subsystem.sh@35 -- # kill -0 1872854 00:13:58.978 07:12:01 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:58.978 Initializing NVMe Controllers 00:13:58.978 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:58.978 Controller IO queue size 128, less than required. 00:13:58.978 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:58.978 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:58.978 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:58.978 Initialization complete. Launching workers. 00:13:58.978 ======================================================== 00:13:58.978 Latency(us) 00:13:58.978 Device Information : IOPS MiB/s Average min max 00:13:58.978 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 174.87 0.09 1019678.78 746.53 2005556.56 00:13:58.978 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 150.03 0.07 939879.27 370.99 1999833.31 00:13:58.978 ======================================================== 00:13:58.978 Total : 324.90 0.16 982829.47 370.99 2005556.56 00:13:58.978 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@35 -- # kill -0 1872854 00:13:59.544 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1872854) - No such process 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@45 -- # NOT wait 1872854 00:13:59.544 07:12:02 -- common/autotest_common.sh@640 -- # local es=0 00:13:59.544 07:12:02 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 1872854 00:13:59.544 07:12:02 -- common/autotest_common.sh@628 -- # local arg=wait 00:13:59.544 07:12:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:59.544 07:12:02 -- common/autotest_common.sh@632 -- # type -t wait 00:13:59.544 07:12:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:59.544 07:12:02 -- common/autotest_common.sh@643 -- # wait 1872854 00:13:59.544 07:12:02 -- common/autotest_common.sh@643 -- # es=1 00:13:59.544 07:12:02 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:59.544 07:12:02 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:59.544 07:12:02 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:59.544 07:12:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.544 07:12:02 -- common/autotest_common.sh@10 -- # set +x 00:13:59.544 07:12:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:59.544 07:12:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.544 07:12:02 -- common/autotest_common.sh@10 -- # set +x 00:13:59.544 [2024-10-16 07:12:02.342592] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.544 07:12:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.544 07:12:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.544 07:12:02 -- common/autotest_common.sh@10 -- # set +x 00:13:59.544 07:12:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@54 -- # perf_pid=1873500 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:59.544 07:12:02 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:59.544 EAL: No free 2048 kB hugepages reported on node 1 00:13:59.544 [2024-10-16 07:12:02.406250] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:00.109 07:12:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.109 07:12:02 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:00.109 07:12:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.675 07:12:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.675 07:12:03 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:00.675 07:12:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:00.933 07:12:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:00.933 07:12:03 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:00.933 07:12:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:01.499 07:12:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:01.499 07:12:04 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:01.499 07:12:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.064 07:12:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.064 07:12:04 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:02.064 07:12:04 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.629 07:12:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.629 07:12:05 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:02.629 07:12:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.887 Initializing NVMe Controllers 00:14:02.887 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:02.887 Controller IO queue size 128, less than required. 00:14:02.887 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:02.887 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:02.887 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:02.887 Initialization complete. Launching workers. 00:14:02.887 ======================================================== 00:14:02.887 Latency(us) 00:14:02.887 Device Information : IOPS MiB/s Average min max 00:14:02.887 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1005087.84 1000181.81 1041936.15 00:14:02.887 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004614.22 1000148.79 1011250.16 00:14:02.887 ======================================================== 00:14:02.887 Total : 256.00 0.12 1004851.03 1000148.79 1041936.15 00:14:02.887 00:14:03.145 07:12:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.145 07:12:05 -- target/delete_subsystem.sh@57 -- # kill -0 1873500 00:14:03.145 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1873500) - No such process 00:14:03.145 07:12:05 -- target/delete_subsystem.sh@67 -- # wait 1873500 00:14:03.145 07:12:05 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:03.145 07:12:05 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:03.145 07:12:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:03.145 07:12:05 -- nvmf/common.sh@116 -- # sync 00:14:03.145 07:12:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:03.145 07:12:05 -- nvmf/common.sh@119 -- # set +e 00:14:03.145 07:12:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:03.145 07:12:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:03.145 rmmod nvme_tcp 00:14:03.145 rmmod nvme_fabrics 00:14:03.145 rmmod nvme_keyring 00:14:03.145 07:12:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:03.145 07:12:05 -- nvmf/common.sh@123 -- # set -e 00:14:03.145 07:12:05 -- nvmf/common.sh@124 -- # return 0 00:14:03.145 07:12:05 -- nvmf/common.sh@477 -- # '[' -n 1872702 ']' 00:14:03.145 07:12:05 -- nvmf/common.sh@478 -- # killprocess 1872702 00:14:03.145 07:12:05 -- common/autotest_common.sh@926 -- # '[' -z 1872702 ']' 00:14:03.145 07:12:05 -- common/autotest_common.sh@930 -- # kill -0 1872702 00:14:03.145 07:12:05 -- common/autotest_common.sh@931 -- # uname 00:14:03.145 07:12:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:03.145 07:12:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1872702 00:14:03.145 07:12:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:03.145 07:12:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:03.145 07:12:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1872702' 00:14:03.145 killing process with pid 1872702 00:14:03.145 07:12:05 -- common/autotest_common.sh@945 -- # kill 1872702 00:14:03.145 07:12:05 -- common/autotest_common.sh@950 -- # wait 1872702 00:14:03.403 07:12:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:03.403 07:12:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:03.403 07:12:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:03.403 07:12:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:03.403 07:12:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:03.403 07:12:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:03.403 07:12:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:03.403 07:12:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.936 07:12:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:05.936 00:14:05.936 real 0m13.145s 00:14:05.936 user 0m29.796s 00:14:05.936 sys 0m2.949s 00:14:05.936 07:12:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:05.936 07:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:05.936 ************************************ 00:14:05.936 END TEST nvmf_delete_subsystem 00:14:05.936 ************************************ 00:14:05.936 07:12:08 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:05.936 07:12:08 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:05.936 07:12:08 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:05.936 07:12:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:05.936 07:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:05.936 ************************************ 00:14:05.936 START TEST nvmf_nvme_cli 00:14:05.936 ************************************ 00:14:05.936 07:12:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:05.936 * Looking for test storage... 00:14:05.936 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:05.936 07:12:08 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:05.936 07:12:08 -- nvmf/common.sh@7 -- # uname -s 00:14:05.936 07:12:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:05.936 07:12:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:05.936 07:12:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:05.936 07:12:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:05.936 07:12:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:05.936 07:12:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:05.936 07:12:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:05.936 07:12:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:05.936 07:12:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:05.936 07:12:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:05.936 07:12:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.936 07:12:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.936 07:12:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:05.936 07:12:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:05.936 07:12:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:05.936 07:12:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:05.936 07:12:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:05.936 07:12:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:05.936 07:12:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:05.936 07:12:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.936 07:12:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.936 07:12:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.936 07:12:08 -- paths/export.sh@5 -- # export PATH 00:14:05.936 07:12:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.936 07:12:08 -- nvmf/common.sh@46 -- # : 0 00:14:05.936 07:12:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:05.936 07:12:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:05.936 07:12:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:05.936 07:12:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:05.936 07:12:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:05.936 07:12:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:05.936 07:12:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:05.936 07:12:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:05.936 07:12:08 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:05.936 07:12:08 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:05.936 07:12:08 -- target/nvme_cli.sh@14 -- # devs=() 00:14:05.936 07:12:08 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:05.936 07:12:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:05.936 07:12:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:05.936 07:12:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:05.936 07:12:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:05.936 07:12:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:05.936 07:12:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.936 07:12:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.936 07:12:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.936 07:12:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:05.936 07:12:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:05.936 07:12:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:05.936 07:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:07.837 07:12:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:07.837 07:12:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:07.837 07:12:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:07.837 07:12:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:07.837 07:12:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:07.837 07:12:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:07.837 07:12:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:07.837 07:12:10 -- nvmf/common.sh@294 -- # net_devs=() 00:14:07.837 07:12:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:07.837 07:12:10 -- nvmf/common.sh@295 -- # e810=() 00:14:07.837 07:12:10 -- nvmf/common.sh@295 -- # local -ga e810 00:14:07.837 07:12:10 -- nvmf/common.sh@296 -- # x722=() 00:14:07.837 07:12:10 -- nvmf/common.sh@296 -- # local -ga x722 00:14:07.837 07:12:10 -- nvmf/common.sh@297 -- # mlx=() 00:14:07.837 07:12:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:07.837 07:12:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:07.837 07:12:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:07.838 07:12:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:07.838 07:12:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:07.838 07:12:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.838 07:12:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:07.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:07.838 07:12:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.838 07:12:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:07.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:07.838 07:12:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.838 07:12:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.838 07:12:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.838 07:12:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:07.838 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:07.838 07:12:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.838 07:12:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.838 07:12:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.838 07:12:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:07.838 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:07.838 07:12:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:07.838 07:12:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:07.838 07:12:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:07.838 07:12:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:07.838 07:12:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:07.838 07:12:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:07.838 07:12:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:07.838 07:12:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:07.838 07:12:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:07.838 07:12:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:07.838 07:12:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:07.838 07:12:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:07.838 07:12:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:07.838 07:12:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:07.838 07:12:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:07.838 07:12:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:07.838 07:12:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:07.838 07:12:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:07.838 07:12:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:07.838 07:12:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:07.838 07:12:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:07.838 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:07.838 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:14:07.838 00:14:07.838 --- 10.0.0.2 ping statistics --- 00:14:07.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.838 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:14:07.838 07:12:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:07.838 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:07.838 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:07.838 00:14:07.838 --- 10.0.0.1 ping statistics --- 00:14:07.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.838 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:07.838 07:12:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:07.838 07:12:10 -- nvmf/common.sh@410 -- # return 0 00:14:07.838 07:12:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:07.838 07:12:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:07.838 07:12:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:07.838 07:12:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:07.838 07:12:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:07.838 07:12:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:07.838 07:12:10 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:07.838 07:12:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:07.838 07:12:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:07.838 07:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.838 07:12:10 -- nvmf/common.sh@469 -- # nvmfpid=1876361 00:14:07.838 07:12:10 -- nvmf/common.sh@470 -- # waitforlisten 1876361 00:14:07.838 07:12:10 -- common/autotest_common.sh@819 -- # '[' -z 1876361 ']' 00:14:07.838 07:12:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:07.838 07:12:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:07.838 07:12:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:07.838 07:12:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:07.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:07.838 07:12:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:07.838 07:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.838 [2024-10-16 07:12:10.527481] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:07.838 [2024-10-16 07:12:10.527558] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:07.838 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.838 [2024-10-16 07:12:10.592781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:07.838 [2024-10-16 07:12:10.701888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:07.838 [2024-10-16 07:12:10.702050] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:07.838 [2024-10-16 07:12:10.702068] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:07.838 [2024-10-16 07:12:10.702081] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:07.838 [2024-10-16 07:12:10.702132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:07.838 [2024-10-16 07:12:10.702203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:07.838 [2024-10-16 07:12:10.702261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:07.838 [2024-10-16 07:12:10.702264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:08.774 07:12:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:08.774 07:12:11 -- common/autotest_common.sh@852 -- # return 0 00:14:08.774 07:12:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:08.774 07:12:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 07:12:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:08.774 07:12:11 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 [2024-10-16 07:12:11.513346] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 Malloc0 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 Malloc1 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 [2024-10-16 07:12:11.600020] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:08.774 07:12:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:08.774 07:12:11 -- common/autotest_common.sh@10 -- # set +x 00:14:08.774 07:12:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:08.774 07:12:11 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:09.032 00:14:09.032 Discovery Log Number of Records 2, Generation counter 2 00:14:09.032 =====Discovery Log Entry 0====== 00:14:09.032 trtype: tcp 00:14:09.032 adrfam: ipv4 00:14:09.032 subtype: current discovery subsystem 00:14:09.032 treq: not required 00:14:09.032 portid: 0 00:14:09.032 trsvcid: 4420 00:14:09.032 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:09.032 traddr: 10.0.0.2 00:14:09.032 eflags: explicit discovery connections, duplicate discovery information 00:14:09.032 sectype: none 00:14:09.032 =====Discovery Log Entry 1====== 00:14:09.032 trtype: tcp 00:14:09.032 adrfam: ipv4 00:14:09.032 subtype: nvme subsystem 00:14:09.032 treq: not required 00:14:09.032 portid: 0 00:14:09.032 trsvcid: 4420 00:14:09.032 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:09.032 traddr: 10.0.0.2 00:14:09.032 eflags: none 00:14:09.032 sectype: none 00:14:09.032 07:12:11 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:09.032 07:12:11 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:09.032 07:12:11 -- nvmf/common.sh@510 -- # local dev _ 00:14:09.032 07:12:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.032 07:12:11 -- nvmf/common.sh@509 -- # nvme list 00:14:09.032 07:12:11 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:09.032 07:12:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.032 07:12:11 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:09.032 07:12:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:09.032 07:12:11 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:09.032 07:12:11 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:09.597 07:12:12 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:09.597 07:12:12 -- common/autotest_common.sh@1177 -- # local i=0 00:14:09.597 07:12:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:09.597 07:12:12 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:14:09.597 07:12:12 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:14:09.597 07:12:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:12.126 07:12:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:12.126 07:12:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:12.126 07:12:14 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:12.126 07:12:14 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:14:12.126 07:12:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:12.126 07:12:14 -- common/autotest_common.sh@1187 -- # return 0 00:14:12.126 07:12:14 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:12.126 07:12:14 -- nvmf/common.sh@510 -- # local dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@509 -- # nvme list 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:12.126 /dev/nvme0n2 ]] 00:14:12.126 07:12:14 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:12.126 07:12:14 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:12.126 07:12:14 -- nvmf/common.sh@510 -- # local dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@509 -- # nvme list 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:12.126 07:12:14 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:12.126 07:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:12.126 07:12:14 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:12.126 07:12:14 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:12.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:12.126 07:12:14 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:12.126 07:12:14 -- common/autotest_common.sh@1198 -- # local i=0 00:14:12.126 07:12:14 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:12.126 07:12:14 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:12.126 07:12:14 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:12.126 07:12:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:12.126 07:12:14 -- common/autotest_common.sh@1210 -- # return 0 00:14:12.126 07:12:14 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:12.126 07:12:14 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:12.126 07:12:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:12.126 07:12:14 -- common/autotest_common.sh@10 -- # set +x 00:14:12.126 07:12:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:12.126 07:12:14 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:12.126 07:12:14 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:12.126 07:12:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:12.126 07:12:14 -- nvmf/common.sh@116 -- # sync 00:14:12.126 07:12:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:12.126 07:12:14 -- nvmf/common.sh@119 -- # set +e 00:14:12.126 07:12:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:12.126 07:12:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:12.126 rmmod nvme_tcp 00:14:12.126 rmmod nvme_fabrics 00:14:12.126 rmmod nvme_keyring 00:14:12.126 07:12:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:12.126 07:12:14 -- nvmf/common.sh@123 -- # set -e 00:14:12.126 07:12:14 -- nvmf/common.sh@124 -- # return 0 00:14:12.126 07:12:14 -- nvmf/common.sh@477 -- # '[' -n 1876361 ']' 00:14:12.126 07:12:14 -- nvmf/common.sh@478 -- # killprocess 1876361 00:14:12.126 07:12:14 -- common/autotest_common.sh@926 -- # '[' -z 1876361 ']' 00:14:12.126 07:12:14 -- common/autotest_common.sh@930 -- # kill -0 1876361 00:14:12.126 07:12:14 -- common/autotest_common.sh@931 -- # uname 00:14:12.126 07:12:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:12.126 07:12:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1876361 00:14:12.126 07:12:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:12.126 07:12:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:12.126 07:12:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1876361' 00:14:12.126 killing process with pid 1876361 00:14:12.126 07:12:14 -- common/autotest_common.sh@945 -- # kill 1876361 00:14:12.126 07:12:14 -- common/autotest_common.sh@950 -- # wait 1876361 00:14:12.385 07:12:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:12.385 07:12:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:12.385 07:12:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:12.385 07:12:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:12.385 07:12:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:12.385 07:12:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.385 07:12:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.385 07:12:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:14.285 07:12:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:14.285 00:14:14.285 real 0m8.791s 00:14:14.285 user 0m17.936s 00:14:14.285 sys 0m2.223s 00:14:14.285 07:12:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:14.285 07:12:17 -- common/autotest_common.sh@10 -- # set +x 00:14:14.285 ************************************ 00:14:14.285 END TEST nvmf_nvme_cli 00:14:14.285 ************************************ 00:14:14.285 07:12:17 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:14.286 07:12:17 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:14.286 07:12:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:14.286 07:12:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:14.286 07:12:17 -- common/autotest_common.sh@10 -- # set +x 00:14:14.286 ************************************ 00:14:14.286 START TEST nvmf_host_management 00:14:14.286 ************************************ 00:14:14.286 07:12:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:14.286 * Looking for test storage... 00:14:14.286 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:14.286 07:12:17 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:14.286 07:12:17 -- nvmf/common.sh@7 -- # uname -s 00:14:14.286 07:12:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:14.286 07:12:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:14.286 07:12:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:14.286 07:12:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:14.286 07:12:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:14.286 07:12:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:14.286 07:12:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:14.286 07:12:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:14.286 07:12:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:14.286 07:12:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:14.286 07:12:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:14.286 07:12:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:14.286 07:12:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:14.286 07:12:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:14.286 07:12:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:14.286 07:12:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:14.286 07:12:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:14.286 07:12:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:14.286 07:12:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:14.286 07:12:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.286 07:12:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.286 07:12:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.286 07:12:17 -- paths/export.sh@5 -- # export PATH 00:14:14.286 07:12:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:14.286 07:12:17 -- nvmf/common.sh@46 -- # : 0 00:14:14.286 07:12:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:14.286 07:12:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:14.286 07:12:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:14.286 07:12:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:14.286 07:12:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:14.286 07:12:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:14.286 07:12:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:14.286 07:12:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:14.286 07:12:17 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:14.286 07:12:17 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:14.286 07:12:17 -- target/host_management.sh@104 -- # nvmftestinit 00:14:14.286 07:12:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:14.286 07:12:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:14.286 07:12:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:14.286 07:12:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:14.286 07:12:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:14.286 07:12:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:14.286 07:12:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:14.286 07:12:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:14.544 07:12:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:14.544 07:12:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:14.544 07:12:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:14.544 07:12:17 -- common/autotest_common.sh@10 -- # set +x 00:14:16.446 07:12:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:16.446 07:12:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:16.446 07:12:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:16.446 07:12:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:16.446 07:12:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:16.446 07:12:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:16.446 07:12:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:16.446 07:12:19 -- nvmf/common.sh@294 -- # net_devs=() 00:14:16.446 07:12:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:16.446 07:12:19 -- nvmf/common.sh@295 -- # e810=() 00:14:16.446 07:12:19 -- nvmf/common.sh@295 -- # local -ga e810 00:14:16.446 07:12:19 -- nvmf/common.sh@296 -- # x722=() 00:14:16.446 07:12:19 -- nvmf/common.sh@296 -- # local -ga x722 00:14:16.446 07:12:19 -- nvmf/common.sh@297 -- # mlx=() 00:14:16.446 07:12:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:16.446 07:12:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:16.446 07:12:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:16.446 07:12:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:16.446 07:12:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.446 07:12:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:16.446 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:16.446 07:12:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:16.446 07:12:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:16.446 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:16.446 07:12:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.446 07:12:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.446 07:12:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.446 07:12:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:16.446 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:16.446 07:12:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.446 07:12:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:16.446 07:12:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:16.446 07:12:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:16.446 07:12:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:16.446 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:16.446 07:12:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:16.446 07:12:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:16.446 07:12:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:16.446 07:12:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:16.446 07:12:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:16.446 07:12:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:16.446 07:12:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:16.446 07:12:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:16.446 07:12:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:16.446 07:12:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:16.446 07:12:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:16.446 07:12:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:16.446 07:12:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:16.446 07:12:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:16.446 07:12:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:16.446 07:12:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:16.446 07:12:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:16.446 07:12:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:16.446 07:12:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:16.446 07:12:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:16.446 07:12:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:16.705 07:12:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:16.705 07:12:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:16.705 07:12:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:16.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:16.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:14:16.705 00:14:16.705 --- 10.0.0.2 ping statistics --- 00:14:16.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.705 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:14:16.705 07:12:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:16.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:16.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:14:16.705 00:14:16.705 --- 10.0.0.1 ping statistics --- 00:14:16.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:16.705 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:14:16.705 07:12:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:16.705 07:12:19 -- nvmf/common.sh@410 -- # return 0 00:14:16.705 07:12:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:16.705 07:12:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:16.705 07:12:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:16.705 07:12:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:16.705 07:12:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:16.705 07:12:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:16.705 07:12:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:16.705 07:12:19 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:16.705 07:12:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:16.705 07:12:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:16.705 07:12:19 -- common/autotest_common.sh@10 -- # set +x 00:14:16.705 ************************************ 00:14:16.705 START TEST nvmf_host_management 00:14:16.705 ************************************ 00:14:16.705 07:12:19 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:14:16.705 07:12:19 -- target/host_management.sh@69 -- # starttarget 00:14:16.705 07:12:19 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:16.705 07:12:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:16.705 07:12:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:16.705 07:12:19 -- common/autotest_common.sh@10 -- # set +x 00:14:16.705 07:12:19 -- nvmf/common.sh@469 -- # nvmfpid=1878905 00:14:16.705 07:12:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:16.705 07:12:19 -- nvmf/common.sh@470 -- # waitforlisten 1878905 00:14:16.705 07:12:19 -- common/autotest_common.sh@819 -- # '[' -z 1878905 ']' 00:14:16.705 07:12:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:16.705 07:12:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:16.705 07:12:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:16.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:16.705 07:12:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:16.705 07:12:19 -- common/autotest_common.sh@10 -- # set +x 00:14:16.705 [2024-10-16 07:12:19.507558] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:16.705 [2024-10-16 07:12:19.507627] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:16.705 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.705 [2024-10-16 07:12:19.574524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:16.964 [2024-10-16 07:12:19.698005] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:16.964 [2024-10-16 07:12:19.698175] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:16.964 [2024-10-16 07:12:19.698195] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:16.964 [2024-10-16 07:12:19.698209] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:16.964 [2024-10-16 07:12:19.698297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:16.964 [2024-10-16 07:12:19.698362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:16.964 [2024-10-16 07:12:19.698418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:16.964 [2024-10-16 07:12:19.698420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:17.898 07:12:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:17.898 07:12:20 -- common/autotest_common.sh@852 -- # return 0 00:14:17.898 07:12:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:17.898 07:12:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 07:12:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:17.898 07:12:20 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:17.898 07:12:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 [2024-10-16 07:12:20.572411] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:17.898 07:12:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:17.898 07:12:20 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:17.898 07:12:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 07:12:20 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:17.898 07:12:20 -- target/host_management.sh@23 -- # cat 00:14:17.898 07:12:20 -- target/host_management.sh@30 -- # rpc_cmd 00:14:17.898 07:12:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 Malloc0 00:14:17.898 [2024-10-16 07:12:20.633810] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.898 07:12:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:17.898 07:12:20 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:17.898 07:12:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 07:12:20 -- target/host_management.sh@73 -- # perfpid=1879090 00:14:17.898 07:12:20 -- target/host_management.sh@74 -- # waitforlisten 1879090 /var/tmp/bdevperf.sock 00:14:17.898 07:12:20 -- common/autotest_common.sh@819 -- # '[' -z 1879090 ']' 00:14:17.898 07:12:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:17.898 07:12:20 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:17.898 07:12:20 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:17.898 07:12:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:17.898 07:12:20 -- nvmf/common.sh@520 -- # config=() 00:14:17.898 07:12:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:17.898 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:17.898 07:12:20 -- nvmf/common.sh@520 -- # local subsystem config 00:14:17.898 07:12:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:17.898 07:12:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:17.898 07:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:17.898 07:12:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:17.898 { 00:14:17.898 "params": { 00:14:17.898 "name": "Nvme$subsystem", 00:14:17.898 "trtype": "$TEST_TRANSPORT", 00:14:17.898 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:17.898 "adrfam": "ipv4", 00:14:17.898 "trsvcid": "$NVMF_PORT", 00:14:17.898 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:17.898 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:17.898 "hdgst": ${hdgst:-false}, 00:14:17.898 "ddgst": ${ddgst:-false} 00:14:17.898 }, 00:14:17.898 "method": "bdev_nvme_attach_controller" 00:14:17.898 } 00:14:17.898 EOF 00:14:17.898 )") 00:14:17.898 07:12:20 -- nvmf/common.sh@542 -- # cat 00:14:17.899 07:12:20 -- nvmf/common.sh@544 -- # jq . 00:14:17.899 07:12:20 -- nvmf/common.sh@545 -- # IFS=, 00:14:17.899 07:12:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:17.899 "params": { 00:14:17.899 "name": "Nvme0", 00:14:17.899 "trtype": "tcp", 00:14:17.899 "traddr": "10.0.0.2", 00:14:17.899 "adrfam": "ipv4", 00:14:17.899 "trsvcid": "4420", 00:14:17.899 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:17.899 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:17.899 "hdgst": false, 00:14:17.899 "ddgst": false 00:14:17.899 }, 00:14:17.899 "method": "bdev_nvme_attach_controller" 00:14:17.899 }' 00:14:17.899 [2024-10-16 07:12:20.701981] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:17.899 [2024-10-16 07:12:20.702085] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1879090 ] 00:14:17.899 EAL: No free 2048 kB hugepages reported on node 1 00:14:17.899 [2024-10-16 07:12:20.762536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:18.158 [2024-10-16 07:12:20.871209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:18.416 Running I/O for 10 seconds... 00:14:18.984 07:12:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:18.984 07:12:21 -- common/autotest_common.sh@852 -- # return 0 00:14:18.984 07:12:21 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:18.984 07:12:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:18.984 07:12:21 -- common/autotest_common.sh@10 -- # set +x 00:14:18.984 07:12:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:18.984 07:12:21 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:18.984 07:12:21 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:18.984 07:12:21 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:18.984 07:12:21 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:18.984 07:12:21 -- target/host_management.sh@52 -- # local ret=1 00:14:18.984 07:12:21 -- target/host_management.sh@53 -- # local i 00:14:18.984 07:12:21 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:18.984 07:12:21 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:18.984 07:12:21 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:18.984 07:12:21 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:18.984 07:12:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:18.984 07:12:21 -- common/autotest_common.sh@10 -- # set +x 00:14:18.984 07:12:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:18.984 07:12:21 -- target/host_management.sh@55 -- # read_io_count=2064 00:14:18.984 07:12:21 -- target/host_management.sh@58 -- # '[' 2064 -ge 100 ']' 00:14:18.984 07:12:21 -- target/host_management.sh@59 -- # ret=0 00:14:18.984 07:12:21 -- target/host_management.sh@60 -- # break 00:14:18.984 07:12:21 -- target/host_management.sh@64 -- # return 0 00:14:18.984 07:12:21 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:18.984 07:12:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:18.984 07:12:21 -- common/autotest_common.sh@10 -- # set +x 00:14:18.984 [2024-10-16 07:12:21.745705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745866] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745878] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745915] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745975] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745987] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.745999] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746065] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746077] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee7e60 is same with the state(5) to be set 00:14:18.984 [2024-10-16 07:12:21.746339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.984 [2024-10-16 07:12:21.746381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.984 [2024-10-16 07:12:21.746412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.984 [2024-10-16 07:12:21.746427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.984 [2024-10-16 07:12:21.746444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.746972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.746985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.985 [2024-10-16 07:12:21.747567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.985 [2024-10-16 07:12:21.747582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.747979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.747994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:18.986 [2024-10-16 07:12:21.748244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:18.986 [2024-10-16 07:12:21.748346] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb71030 was disconnected and freed. reset controller. 00:14:18.986 [2024-10-16 07:12:21.749479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:18.986 07:12:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:18.986 07:12:21 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:18.986 07:12:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:18.986 07:12:21 -- common/autotest_common.sh@10 -- # set +x 00:14:18.986 task offset: 26624 on job bdev=Nvme0n1 fails 00:14:18.986 00:14:18.986 Latency(us) 00:14:18.986 [2024-10-16T05:12:21.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.986 [2024-10-16T05:12:21.926Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:18.986 [2024-10-16T05:12:21.926Z] Job: Nvme0n1 ended in about 0.58 seconds with error 00:14:18.986 Verification LBA range: start 0x0 length 0x400 00:14:18.986 Nvme0n1 : 0.58 3863.09 241.44 110.67 0.00 15853.81 2536.49 23204.60 00:14:18.986 [2024-10-16T05:12:21.926Z] =================================================================================================================== 00:14:18.986 [2024-10-16T05:12:21.926Z] Total : 3863.09 241.44 110.67 0.00 15853.81 2536.49 23204.60 00:14:18.986 [2024-10-16 07:12:21.751384] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:18.986 [2024-10-16 07:12:21.751414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb73160 (9): Bad file descriptor 00:14:18.986 07:12:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:18.986 07:12:21 -- target/host_management.sh@87 -- # sleep 1 00:14:18.986 [2024-10-16 07:12:21.799981] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:19.919 07:12:22 -- target/host_management.sh@91 -- # kill -9 1879090 00:14:19.920 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1879090) - No such process 00:14:19.920 07:12:22 -- target/host_management.sh@91 -- # true 00:14:19.920 07:12:22 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:19.920 07:12:22 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:19.920 07:12:22 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:19.920 07:12:22 -- nvmf/common.sh@520 -- # config=() 00:14:19.920 07:12:22 -- nvmf/common.sh@520 -- # local subsystem config 00:14:19.920 07:12:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:19.920 07:12:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:19.920 { 00:14:19.920 "params": { 00:14:19.920 "name": "Nvme$subsystem", 00:14:19.920 "trtype": "$TEST_TRANSPORT", 00:14:19.920 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:19.920 "adrfam": "ipv4", 00:14:19.920 "trsvcid": "$NVMF_PORT", 00:14:19.920 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:19.920 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:19.920 "hdgst": ${hdgst:-false}, 00:14:19.920 "ddgst": ${ddgst:-false} 00:14:19.920 }, 00:14:19.920 "method": "bdev_nvme_attach_controller" 00:14:19.920 } 00:14:19.920 EOF 00:14:19.920 )") 00:14:19.920 07:12:22 -- nvmf/common.sh@542 -- # cat 00:14:19.920 07:12:22 -- nvmf/common.sh@544 -- # jq . 00:14:19.920 07:12:22 -- nvmf/common.sh@545 -- # IFS=, 00:14:19.920 07:12:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:19.920 "params": { 00:14:19.920 "name": "Nvme0", 00:14:19.920 "trtype": "tcp", 00:14:19.920 "traddr": "10.0.0.2", 00:14:19.920 "adrfam": "ipv4", 00:14:19.920 "trsvcid": "4420", 00:14:19.920 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.920 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:19.920 "hdgst": false, 00:14:19.920 "ddgst": false 00:14:19.920 }, 00:14:19.920 "method": "bdev_nvme_attach_controller" 00:14:19.920 }' 00:14:19.920 [2024-10-16 07:12:22.801959] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:19.920 [2024-10-16 07:12:22.802052] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1879374 ] 00:14:19.920 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.920 [2024-10-16 07:12:22.860916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:20.177 [2024-10-16 07:12:22.971213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.436 Running I/O for 1 seconds... 00:14:21.369 00:14:21.369 Latency(us) 00:14:21.369 [2024-10-16T05:12:24.309Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:21.369 [2024-10-16T05:12:24.309Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:21.369 Verification LBA range: start 0x0 length 0x400 00:14:21.369 Nvme0n1 : 1.01 4011.32 250.71 0.00 0.00 15691.90 1274.31 21165.70 00:14:21.369 [2024-10-16T05:12:24.309Z] =================================================================================================================== 00:14:21.369 [2024-10-16T05:12:24.309Z] Total : 4011.32 250.71 0.00 0.00 15691.90 1274.31 21165.70 00:14:21.627 07:12:24 -- target/host_management.sh@101 -- # stoptarget 00:14:21.627 07:12:24 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:21.627 07:12:24 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:21.627 07:12:24 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:21.627 07:12:24 -- target/host_management.sh@40 -- # nvmftestfini 00:14:21.627 07:12:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:21.627 07:12:24 -- nvmf/common.sh@116 -- # sync 00:14:21.627 07:12:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:21.627 07:12:24 -- nvmf/common.sh@119 -- # set +e 00:14:21.627 07:12:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:21.627 07:12:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:21.627 rmmod nvme_tcp 00:14:21.627 rmmod nvme_fabrics 00:14:21.627 rmmod nvme_keyring 00:14:21.627 07:12:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:21.627 07:12:24 -- nvmf/common.sh@123 -- # set -e 00:14:21.627 07:12:24 -- nvmf/common.sh@124 -- # return 0 00:14:21.627 07:12:24 -- nvmf/common.sh@477 -- # '[' -n 1878905 ']' 00:14:21.627 07:12:24 -- nvmf/common.sh@478 -- # killprocess 1878905 00:14:21.627 07:12:24 -- common/autotest_common.sh@926 -- # '[' -z 1878905 ']' 00:14:21.627 07:12:24 -- common/autotest_common.sh@930 -- # kill -0 1878905 00:14:21.627 07:12:24 -- common/autotest_common.sh@931 -- # uname 00:14:21.627 07:12:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:21.627 07:12:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1878905 00:14:21.885 07:12:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:21.886 07:12:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:21.886 07:12:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1878905' 00:14:21.886 killing process with pid 1878905 00:14:21.886 07:12:24 -- common/autotest_common.sh@945 -- # kill 1878905 00:14:21.886 07:12:24 -- common/autotest_common.sh@950 -- # wait 1878905 00:14:22.144 [2024-10-16 07:12:24.866965] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:22.144 07:12:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:22.144 07:12:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:22.144 07:12:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:22.144 07:12:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:22.144 07:12:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:22.144 07:12:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:22.144 07:12:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:22.144 07:12:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.045 07:12:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:24.045 00:14:24.045 real 0m7.474s 00:14:24.045 user 0m23.431s 00:14:24.045 sys 0m1.394s 00:14:24.045 07:12:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:24.045 07:12:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.045 ************************************ 00:14:24.045 END TEST nvmf_host_management 00:14:24.045 ************************************ 00:14:24.045 07:12:26 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:24.045 00:14:24.045 real 0m9.812s 00:14:24.045 user 0m24.277s 00:14:24.045 sys 0m2.918s 00:14:24.045 07:12:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:24.045 07:12:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.045 ************************************ 00:14:24.045 END TEST nvmf_host_management 00:14:24.045 ************************************ 00:14:24.303 07:12:26 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:24.303 07:12:26 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:24.303 07:12:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:24.303 07:12:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.303 ************************************ 00:14:24.303 START TEST nvmf_lvol 00:14:24.303 ************************************ 00:14:24.303 07:12:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:24.303 * Looking for test storage... 00:14:24.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:24.303 07:12:27 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:24.303 07:12:27 -- nvmf/common.sh@7 -- # uname -s 00:14:24.303 07:12:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:24.303 07:12:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:24.303 07:12:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:24.303 07:12:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:24.303 07:12:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:24.303 07:12:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:24.303 07:12:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:24.303 07:12:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:24.303 07:12:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:24.303 07:12:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:24.303 07:12:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:24.303 07:12:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:24.303 07:12:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:24.303 07:12:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:24.303 07:12:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:24.303 07:12:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:24.303 07:12:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:24.303 07:12:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:24.303 07:12:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:24.303 07:12:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.303 07:12:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.303 07:12:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.303 07:12:27 -- paths/export.sh@5 -- # export PATH 00:14:24.304 07:12:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.304 07:12:27 -- nvmf/common.sh@46 -- # : 0 00:14:24.304 07:12:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:24.304 07:12:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:24.304 07:12:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:24.304 07:12:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:24.304 07:12:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:24.304 07:12:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:24.304 07:12:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:24.304 07:12:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:24.304 07:12:27 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:24.304 07:12:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:24.304 07:12:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:24.304 07:12:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:24.304 07:12:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:24.304 07:12:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:24.304 07:12:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.304 07:12:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.304 07:12:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.304 07:12:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:24.304 07:12:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:24.304 07:12:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:24.304 07:12:27 -- common/autotest_common.sh@10 -- # set +x 00:14:26.832 07:12:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:26.832 07:12:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:26.832 07:12:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:26.832 07:12:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:26.832 07:12:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:26.832 07:12:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:26.832 07:12:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:26.832 07:12:29 -- nvmf/common.sh@294 -- # net_devs=() 00:14:26.832 07:12:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:26.832 07:12:29 -- nvmf/common.sh@295 -- # e810=() 00:14:26.832 07:12:29 -- nvmf/common.sh@295 -- # local -ga e810 00:14:26.832 07:12:29 -- nvmf/common.sh@296 -- # x722=() 00:14:26.832 07:12:29 -- nvmf/common.sh@296 -- # local -ga x722 00:14:26.832 07:12:29 -- nvmf/common.sh@297 -- # mlx=() 00:14:26.832 07:12:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:26.832 07:12:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:26.832 07:12:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:26.832 07:12:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:26.832 07:12:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:26.832 07:12:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.832 07:12:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:26.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:26.832 07:12:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.832 07:12:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.832 07:12:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:26.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:26.833 07:12:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:26.833 07:12:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.833 07:12:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.833 07:12:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.833 07:12:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.833 07:12:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:26.833 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:26.833 07:12:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.833 07:12:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.833 07:12:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.833 07:12:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.833 07:12:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.833 07:12:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:26.833 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:26.833 07:12:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.833 07:12:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:26.833 07:12:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:26.833 07:12:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:26.833 07:12:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:26.833 07:12:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:26.833 07:12:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:26.833 07:12:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:26.833 07:12:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:26.833 07:12:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:26.833 07:12:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:26.833 07:12:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:26.833 07:12:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:26.833 07:12:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:26.833 07:12:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:26.833 07:12:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:26.833 07:12:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:26.833 07:12:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:26.833 07:12:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:26.833 07:12:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:26.833 07:12:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:26.833 07:12:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:26.833 07:12:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:26.833 07:12:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:26.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:26.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.390 ms 00:14:26.833 00:14:26.833 --- 10.0.0.2 ping statistics --- 00:14:26.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.833 rtt min/avg/max/mdev = 0.390/0.390/0.390/0.000 ms 00:14:26.833 07:12:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:26.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:26.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:14:26.833 00:14:26.833 --- 10.0.0.1 ping statistics --- 00:14:26.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.833 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:14:26.833 07:12:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:26.833 07:12:29 -- nvmf/common.sh@410 -- # return 0 00:14:26.833 07:12:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:26.833 07:12:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:26.833 07:12:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:26.833 07:12:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:26.833 07:12:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:26.833 07:12:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:26.833 07:12:29 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:26.833 07:12:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:26.833 07:12:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:26.833 07:12:29 -- common/autotest_common.sh@10 -- # set +x 00:14:26.833 07:12:29 -- nvmf/common.sh@469 -- # nvmfpid=1881475 00:14:26.833 07:12:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:26.833 07:12:29 -- nvmf/common.sh@470 -- # waitforlisten 1881475 00:14:26.833 07:12:29 -- common/autotest_common.sh@819 -- # '[' -z 1881475 ']' 00:14:26.833 07:12:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:26.833 07:12:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:26.833 07:12:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:26.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:26.833 07:12:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:26.833 07:12:29 -- common/autotest_common.sh@10 -- # set +x 00:14:26.833 [2024-10-16 07:12:29.386369] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:26.833 [2024-10-16 07:12:29.386442] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:26.833 EAL: No free 2048 kB hugepages reported on node 1 00:14:26.833 [2024-10-16 07:12:29.458257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:26.833 [2024-10-16 07:12:29.569680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:26.833 [2024-10-16 07:12:29.569847] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:26.833 [2024-10-16 07:12:29.569875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:26.833 [2024-10-16 07:12:29.569897] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:26.833 [2024-10-16 07:12:29.569957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:26.833 [2024-10-16 07:12:29.570030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:26.833 [2024-10-16 07:12:29.570039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:27.811 07:12:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:27.811 07:12:30 -- common/autotest_common.sh@852 -- # return 0 00:14:27.811 07:12:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:27.811 07:12:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:27.811 07:12:30 -- common/autotest_common.sh@10 -- # set +x 00:14:27.811 07:12:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:27.811 07:12:30 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:28.107 [2024-10-16 07:12:30.719480] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:28.107 07:12:30 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:28.107 07:12:31 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:28.107 07:12:31 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:28.411 07:12:31 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:28.411 07:12:31 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:28.669 07:12:31 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:28.927 07:12:31 -- target/nvmf_lvol.sh@29 -- # lvs=efb3aabb-5a48-46de-a630-00239ce38f4a 00:14:28.927 07:12:31 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u efb3aabb-5a48-46de-a630-00239ce38f4a lvol 20 00:14:29.185 07:12:32 -- target/nvmf_lvol.sh@32 -- # lvol=611e72ff-3c73-4c11-95dc-c6000ba58da6 00:14:29.185 07:12:32 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:29.444 07:12:32 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 611e72ff-3c73-4c11-95dc-c6000ba58da6 00:14:29.702 07:12:32 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:29.960 [2024-10-16 07:12:32.764798] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:29.960 07:12:32 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:30.218 07:12:33 -- target/nvmf_lvol.sh@42 -- # perf_pid=1882054 00:14:30.218 07:12:33 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:30.218 07:12:33 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:30.218 EAL: No free 2048 kB hugepages reported on node 1 00:14:31.152 07:12:34 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 611e72ff-3c73-4c11-95dc-c6000ba58da6 MY_SNAPSHOT 00:14:31.411 07:12:34 -- target/nvmf_lvol.sh@47 -- # snapshot=cc238b82-8ad4-42d1-92bc-76b1f2163913 00:14:31.411 07:12:34 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 611e72ff-3c73-4c11-95dc-c6000ba58da6 30 00:14:31.977 07:12:34 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone cc238b82-8ad4-42d1-92bc-76b1f2163913 MY_CLONE 00:14:31.977 07:12:34 -- target/nvmf_lvol.sh@49 -- # clone=b2d1f24b-e279-4e15-b3a3-6b31fd3c9bcf 00:14:31.977 07:12:34 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate b2d1f24b-e279-4e15-b3a3-6b31fd3c9bcf 00:14:32.910 07:12:35 -- target/nvmf_lvol.sh@53 -- # wait 1882054 00:14:41.019 Initializing NVMe Controllers 00:14:41.019 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:41.019 Controller IO queue size 128, less than required. 00:14:41.019 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:41.019 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:41.019 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:41.019 Initialization complete. Launching workers. 00:14:41.019 ======================================================== 00:14:41.019 Latency(us) 00:14:41.019 Device Information : IOPS MiB/s Average min max 00:14:41.019 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10791.90 42.16 11867.02 1860.20 74079.22 00:14:41.019 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10682.70 41.73 11985.30 2040.73 67242.66 00:14:41.019 ======================================================== 00:14:41.019 Total : 21474.60 83.89 11925.86 1860.20 74079.22 00:14:41.019 00:14:41.019 07:12:43 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:41.019 07:12:43 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 611e72ff-3c73-4c11-95dc-c6000ba58da6 00:14:41.278 07:12:43 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u efb3aabb-5a48-46de-a630-00239ce38f4a 00:14:41.535 07:12:44 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:41.535 07:12:44 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:41.535 07:12:44 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:41.535 07:12:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:41.535 07:12:44 -- nvmf/common.sh@116 -- # sync 00:14:41.535 07:12:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:41.535 07:12:44 -- nvmf/common.sh@119 -- # set +e 00:14:41.535 07:12:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:41.535 07:12:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:41.535 rmmod nvme_tcp 00:14:41.535 rmmod nvme_fabrics 00:14:41.535 rmmod nvme_keyring 00:14:41.535 07:12:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:41.535 07:12:44 -- nvmf/common.sh@123 -- # set -e 00:14:41.535 07:12:44 -- nvmf/common.sh@124 -- # return 0 00:14:41.535 07:12:44 -- nvmf/common.sh@477 -- # '[' -n 1881475 ']' 00:14:41.535 07:12:44 -- nvmf/common.sh@478 -- # killprocess 1881475 00:14:41.535 07:12:44 -- common/autotest_common.sh@926 -- # '[' -z 1881475 ']' 00:14:41.536 07:12:44 -- common/autotest_common.sh@930 -- # kill -0 1881475 00:14:41.536 07:12:44 -- common/autotest_common.sh@931 -- # uname 00:14:41.536 07:12:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:41.536 07:12:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1881475 00:14:41.536 07:12:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:41.536 07:12:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:41.536 07:12:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1881475' 00:14:41.536 killing process with pid 1881475 00:14:41.536 07:12:44 -- common/autotest_common.sh@945 -- # kill 1881475 00:14:41.536 07:12:44 -- common/autotest_common.sh@950 -- # wait 1881475 00:14:41.794 07:12:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.794 07:12:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.794 07:12:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.794 07:12:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.794 07:12:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.794 07:12:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.794 07:12:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.794 07:12:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.326 07:12:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:44.326 00:14:44.326 real 0m19.777s 00:14:44.326 user 1m6.987s 00:14:44.326 sys 0m5.556s 00:14:44.326 07:12:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:44.326 07:12:46 -- common/autotest_common.sh@10 -- # set +x 00:14:44.326 ************************************ 00:14:44.326 END TEST nvmf_lvol 00:14:44.326 ************************************ 00:14:44.326 07:12:46 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:44.326 07:12:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:44.326 07:12:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:44.326 07:12:46 -- common/autotest_common.sh@10 -- # set +x 00:14:44.326 ************************************ 00:14:44.326 START TEST nvmf_lvs_grow 00:14:44.326 ************************************ 00:14:44.326 07:12:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:44.326 * Looking for test storage... 00:14:44.326 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:44.326 07:12:46 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:44.326 07:12:46 -- nvmf/common.sh@7 -- # uname -s 00:14:44.326 07:12:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:44.326 07:12:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:44.326 07:12:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:44.326 07:12:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:44.326 07:12:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:44.326 07:12:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:44.326 07:12:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:44.326 07:12:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:44.326 07:12:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.326 07:12:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.326 07:12:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.326 07:12:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.326 07:12:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.326 07:12:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.326 07:12:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.326 07:12:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:44.326 07:12:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.326 07:12:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.326 07:12:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.326 07:12:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.326 07:12:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.326 07:12:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.326 07:12:46 -- paths/export.sh@5 -- # export PATH 00:14:44.326 07:12:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.326 07:12:46 -- nvmf/common.sh@46 -- # : 0 00:14:44.326 07:12:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:44.326 07:12:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:44.326 07:12:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:44.326 07:12:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.326 07:12:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.326 07:12:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:44.326 07:12:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:44.326 07:12:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:44.326 07:12:46 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:44.326 07:12:46 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:44.326 07:12:46 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:44.326 07:12:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:44.326 07:12:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.326 07:12:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:44.326 07:12:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:44.326 07:12:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:44.326 07:12:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.327 07:12:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.327 07:12:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.327 07:12:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:44.327 07:12:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:44.327 07:12:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:44.327 07:12:46 -- common/autotest_common.sh@10 -- # set +x 00:14:46.227 07:12:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:46.227 07:12:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:46.227 07:12:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:46.227 07:12:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:46.227 07:12:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:46.227 07:12:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:46.227 07:12:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:46.227 07:12:48 -- nvmf/common.sh@294 -- # net_devs=() 00:14:46.227 07:12:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:46.227 07:12:48 -- nvmf/common.sh@295 -- # e810=() 00:14:46.227 07:12:48 -- nvmf/common.sh@295 -- # local -ga e810 00:14:46.227 07:12:48 -- nvmf/common.sh@296 -- # x722=() 00:14:46.227 07:12:48 -- nvmf/common.sh@296 -- # local -ga x722 00:14:46.227 07:12:48 -- nvmf/common.sh@297 -- # mlx=() 00:14:46.227 07:12:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:46.227 07:12:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:46.227 07:12:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:46.227 07:12:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:46.227 07:12:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:46.227 07:12:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:46.227 07:12:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:46.227 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:46.227 07:12:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:46.227 07:12:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:46.227 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:46.227 07:12:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:46.227 07:12:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:46.228 07:12:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:46.228 07:12:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:46.228 07:12:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:46.228 07:12:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:46.228 07:12:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:46.228 07:12:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:46.228 07:12:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:46.228 07:12:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:46.228 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:46.228 07:12:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:46.228 07:12:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:46.228 07:12:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:46.228 07:12:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:46.228 07:12:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:46.228 07:12:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:46.228 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:46.228 07:12:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:46.228 07:12:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:46.228 07:12:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:46.228 07:12:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:46.228 07:12:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:46.228 07:12:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:46.228 07:12:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:46.228 07:12:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:46.228 07:12:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:46.228 07:12:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:46.228 07:12:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:46.228 07:12:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:46.228 07:12:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:46.228 07:12:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:46.228 07:12:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:46.228 07:12:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:46.228 07:12:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:46.228 07:12:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:46.228 07:12:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:46.228 07:12:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:46.228 07:12:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:46.228 07:12:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:46.228 07:12:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:46.228 07:12:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:46.228 07:12:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:46.228 07:12:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:46.228 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:46.228 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:14:46.228 00:14:46.228 --- 10.0.0.2 ping statistics --- 00:14:46.228 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.228 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:14:46.228 07:12:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:46.228 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:46.228 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:14:46.228 00:14:46.228 --- 10.0.0.1 ping statistics --- 00:14:46.228 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.228 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:14:46.228 07:12:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:46.228 07:12:49 -- nvmf/common.sh@410 -- # return 0 00:14:46.228 07:12:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:46.228 07:12:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:46.228 07:12:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:46.228 07:12:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:46.228 07:12:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:46.228 07:12:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:46.228 07:12:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:46.228 07:12:49 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:46.228 07:12:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:46.228 07:12:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:46.228 07:12:49 -- common/autotest_common.sh@10 -- # set +x 00:14:46.228 07:12:49 -- nvmf/common.sh@469 -- # nvmfpid=1885367 00:14:46.228 07:12:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:46.228 07:12:49 -- nvmf/common.sh@470 -- # waitforlisten 1885367 00:14:46.228 07:12:49 -- common/autotest_common.sh@819 -- # '[' -z 1885367 ']' 00:14:46.228 07:12:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:46.228 07:12:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:46.228 07:12:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:46.228 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:46.228 07:12:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:46.228 07:12:49 -- common/autotest_common.sh@10 -- # set +x 00:14:46.228 [2024-10-16 07:12:49.133404] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:46.228 [2024-10-16 07:12:49.133478] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:46.228 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.487 [2024-10-16 07:12:49.198534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:46.487 [2024-10-16 07:12:49.307721] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:46.487 [2024-10-16 07:12:49.307873] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.487 [2024-10-16 07:12:49.307891] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.487 [2024-10-16 07:12:49.307903] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.487 [2024-10-16 07:12:49.307931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:47.422 07:12:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:47.422 07:12:50 -- common/autotest_common.sh@852 -- # return 0 00:14:47.422 07:12:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.422 07:12:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:47.422 07:12:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.422 07:12:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:47.422 07:12:50 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:47.679 [2024-10-16 07:12:50.455411] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:47.679 07:12:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:47.679 07:12:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:47.679 07:12:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.679 ************************************ 00:14:47.679 START TEST lvs_grow_clean 00:14:47.679 ************************************ 00:14:47.679 07:12:50 -- common/autotest_common.sh@1104 -- # lvs_grow 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:47.679 07:12:50 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:47.938 07:12:50 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:47.938 07:12:50 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:48.197 07:12:51 -- target/nvmf_lvs_grow.sh@28 -- # lvs=50a1e813-0471-4da0-9637-1f1c4d026222 00:14:48.197 07:12:51 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:14:48.197 07:12:51 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:48.455 07:12:51 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:48.455 07:12:51 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:48.455 07:12:51 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 50a1e813-0471-4da0-9637-1f1c4d026222 lvol 150 00:14:48.713 07:12:51 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 00:14:48.713 07:12:51 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:48.713 07:12:51 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:48.971 [2024-10-16 07:12:51.874217] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:48.971 [2024-10-16 07:12:51.874301] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:48.971 true 00:14:48.971 07:12:51 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:14:48.971 07:12:51 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:49.537 07:12:52 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:49.537 07:12:52 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:49.795 07:12:52 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 00:14:50.053 07:12:52 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:50.311 [2024-10-16 07:12:53.029843] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:50.311 07:12:53 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:50.570 07:12:53 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1885886 00:14:50.570 07:12:53 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:50.570 07:12:53 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:50.570 07:12:53 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1885886 /var/tmp/bdevperf.sock 00:14:50.570 07:12:53 -- common/autotest_common.sh@819 -- # '[' -z 1885886 ']' 00:14:50.570 07:12:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:50.570 07:12:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:50.570 07:12:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:50.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:50.570 07:12:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:50.570 07:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:50.570 [2024-10-16 07:12:53.341648] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:50.570 [2024-10-16 07:12:53.341736] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1885886 ] 00:14:50.570 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.570 [2024-10-16 07:12:53.406098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:50.828 [2024-10-16 07:12:53.521352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.394 07:12:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:51.394 07:12:54 -- common/autotest_common.sh@852 -- # return 0 00:14:51.394 07:12:54 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:51.959 Nvme0n1 00:14:51.959 07:12:54 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:52.217 [ 00:14:52.217 { 00:14:52.217 "name": "Nvme0n1", 00:14:52.217 "aliases": [ 00:14:52.217 "a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9" 00:14:52.217 ], 00:14:52.217 "product_name": "NVMe disk", 00:14:52.217 "block_size": 4096, 00:14:52.217 "num_blocks": 38912, 00:14:52.217 "uuid": "a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9", 00:14:52.217 "assigned_rate_limits": { 00:14:52.217 "rw_ios_per_sec": 0, 00:14:52.217 "rw_mbytes_per_sec": 0, 00:14:52.217 "r_mbytes_per_sec": 0, 00:14:52.217 "w_mbytes_per_sec": 0 00:14:52.217 }, 00:14:52.217 "claimed": false, 00:14:52.217 "zoned": false, 00:14:52.217 "supported_io_types": { 00:14:52.217 "read": true, 00:14:52.217 "write": true, 00:14:52.217 "unmap": true, 00:14:52.217 "write_zeroes": true, 00:14:52.217 "flush": true, 00:14:52.217 "reset": true, 00:14:52.217 "compare": true, 00:14:52.217 "compare_and_write": true, 00:14:52.217 "abort": true, 00:14:52.217 "nvme_admin": true, 00:14:52.217 "nvme_io": true 00:14:52.217 }, 00:14:52.217 "driver_specific": { 00:14:52.217 "nvme": [ 00:14:52.217 { 00:14:52.217 "trid": { 00:14:52.217 "trtype": "TCP", 00:14:52.217 "adrfam": "IPv4", 00:14:52.217 "traddr": "10.0.0.2", 00:14:52.217 "trsvcid": "4420", 00:14:52.217 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:52.217 }, 00:14:52.217 "ctrlr_data": { 00:14:52.217 "cntlid": 1, 00:14:52.217 "vendor_id": "0x8086", 00:14:52.217 "model_number": "SPDK bdev Controller", 00:14:52.217 "serial_number": "SPDK0", 00:14:52.217 "firmware_revision": "24.01.1", 00:14:52.217 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:52.217 "oacs": { 00:14:52.217 "security": 0, 00:14:52.217 "format": 0, 00:14:52.217 "firmware": 0, 00:14:52.217 "ns_manage": 0 00:14:52.217 }, 00:14:52.217 "multi_ctrlr": true, 00:14:52.217 "ana_reporting": false 00:14:52.217 }, 00:14:52.217 "vs": { 00:14:52.217 "nvme_version": "1.3" 00:14:52.217 }, 00:14:52.217 "ns_data": { 00:14:52.217 "id": 1, 00:14:52.217 "can_share": true 00:14:52.217 } 00:14:52.217 } 00:14:52.217 ], 00:14:52.217 "mp_policy": "active_passive" 00:14:52.217 } 00:14:52.217 } 00:14:52.217 ] 00:14:52.217 07:12:54 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1886093 00:14:52.217 07:12:54 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:52.217 07:12:54 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:52.217 Running I/O for 10 seconds... 00:14:53.152 Latency(us) 00:14:53.152 [2024-10-16T05:12:56.092Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:53.152 [2024-10-16T05:12:56.092Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.152 Nvme0n1 : 1.00 14480.00 56.56 0.00 0.00 0.00 0.00 0.00 00:14:53.152 [2024-10-16T05:12:56.092Z] =================================================================================================================== 00:14:53.152 [2024-10-16T05:12:56.092Z] Total : 14480.00 56.56 0.00 0.00 0.00 0.00 0.00 00:14:53.152 00:14:54.086 07:12:56 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:14:54.344 [2024-10-16T05:12:57.284Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.344 Nvme0n1 : 2.00 14613.50 57.08 0.00 0.00 0.00 0.00 0.00 00:14:54.344 [2024-10-16T05:12:57.284Z] =================================================================================================================== 00:14:54.344 [2024-10-16T05:12:57.284Z] Total : 14613.50 57.08 0.00 0.00 0.00 0.00 0.00 00:14:54.344 00:14:54.344 true 00:14:54.344 07:12:57 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:14:54.344 07:12:57 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:54.602 07:12:57 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:54.602 07:12:57 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:54.602 07:12:57 -- target/nvmf_lvs_grow.sh@65 -- # wait 1886093 00:14:55.168 [2024-10-16T05:12:58.108Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.168 Nvme0n1 : 3.00 14501.00 56.64 0.00 0.00 0.00 0.00 0.00 00:14:55.168 [2024-10-16T05:12:58.108Z] =================================================================================================================== 00:14:55.168 [2024-10-16T05:12:58.108Z] Total : 14501.00 56.64 0.00 0.00 0.00 0.00 0.00 00:14:55.168 00:14:56.543 [2024-10-16T05:12:59.483Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.543 Nvme0n1 : 4.00 14309.75 55.90 0.00 0.00 0.00 0.00 0.00 00:14:56.543 [2024-10-16T05:12:59.483Z] =================================================================================================================== 00:14:56.543 [2024-10-16T05:12:59.483Z] Total : 14309.75 55.90 0.00 0.00 0.00 0.00 0.00 00:14:56.543 00:14:57.477 [2024-10-16T05:13:00.417Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.477 Nvme0n1 : 5.00 14223.80 55.56 0.00 0.00 0.00 0.00 0.00 00:14:57.477 [2024-10-16T05:13:00.417Z] =================================================================================================================== 00:14:57.477 [2024-10-16T05:13:00.417Z] Total : 14223.80 55.56 0.00 0.00 0.00 0.00 0.00 00:14:57.477 00:14:58.414 [2024-10-16T05:13:01.354Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.414 Nvme0n1 : 6.00 14154.50 55.29 0.00 0.00 0.00 0.00 0.00 00:14:58.414 [2024-10-16T05:13:01.354Z] =================================================================================================================== 00:14:58.414 [2024-10-16T05:13:01.354Z] Total : 14154.50 55.29 0.00 0.00 0.00 0.00 0.00 00:14:58.414 00:14:59.416 [2024-10-16T05:13:02.356Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.416 Nvme0n1 : 7.00 14140.43 55.24 0.00 0.00 0.00 0.00 0.00 00:14:59.416 [2024-10-16T05:13:02.356Z] =================================================================================================================== 00:14:59.416 [2024-10-16T05:13:02.356Z] Total : 14140.43 55.24 0.00 0.00 0.00 0.00 0.00 00:14:59.416 00:15:00.349 [2024-10-16T05:13:03.289Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.349 Nvme0n1 : 8.00 14123.88 55.17 0.00 0.00 0.00 0.00 0.00 00:15:00.349 [2024-10-16T05:13:03.289Z] =================================================================================================================== 00:15:00.349 [2024-10-16T05:13:03.289Z] Total : 14123.88 55.17 0.00 0.00 0.00 0.00 0.00 00:15:00.349 00:15:01.283 [2024-10-16T05:13:04.223Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.283 Nvme0n1 : 9.00 14111.00 55.12 0.00 0.00 0.00 0.00 0.00 00:15:01.283 [2024-10-16T05:13:04.223Z] =================================================================================================================== 00:15:01.283 [2024-10-16T05:13:04.223Z] Total : 14111.00 55.12 0.00 0.00 0.00 0.00 0.00 00:15:01.283 00:15:02.216 [2024-10-16T05:13:05.156Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.216 Nvme0n1 : 10.00 14104.70 55.10 0.00 0.00 0.00 0.00 0.00 00:15:02.216 [2024-10-16T05:13:05.156Z] =================================================================================================================== 00:15:02.216 [2024-10-16T05:13:05.156Z] Total : 14104.70 55.10 0.00 0.00 0.00 0.00 0.00 00:15:02.216 00:15:02.216 00:15:02.216 Latency(us) 00:15:02.216 [2024-10-16T05:13:05.156Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.216 [2024-10-16T05:13:05.156Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.216 Nvme0n1 : 10.01 14104.55 55.10 0.00 0.00 9066.21 2354.44 17087.91 00:15:02.216 [2024-10-16T05:13:05.156Z] =================================================================================================================== 00:15:02.216 [2024-10-16T05:13:05.156Z] Total : 14104.55 55.10 0.00 0.00 9066.21 2354.44 17087.91 00:15:02.216 0 00:15:02.216 07:13:05 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1885886 00:15:02.216 07:13:05 -- common/autotest_common.sh@926 -- # '[' -z 1885886 ']' 00:15:02.216 07:13:05 -- common/autotest_common.sh@930 -- # kill -0 1885886 00:15:02.216 07:13:05 -- common/autotest_common.sh@931 -- # uname 00:15:02.216 07:13:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:02.216 07:13:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1885886 00:15:02.216 07:13:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:02.216 07:13:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:02.216 07:13:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1885886' 00:15:02.216 killing process with pid 1885886 00:15:02.216 07:13:05 -- common/autotest_common.sh@945 -- # kill 1885886 00:15:02.216 Received shutdown signal, test time was about 10.000000 seconds 00:15:02.216 00:15:02.216 Latency(us) 00:15:02.216 [2024-10-16T05:13:05.156Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.216 [2024-10-16T05:13:05.156Z] =================================================================================================================== 00:15:02.216 [2024-10-16T05:13:05.156Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:02.216 07:13:05 -- common/autotest_common.sh@950 -- # wait 1885886 00:15:02.474 07:13:05 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:03.040 07:13:05 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:03.040 07:13:05 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:03.297 07:13:05 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:03.298 07:13:05 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:03.298 07:13:05 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:03.555 [2024-10-16 07:13:06.264741] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:03.555 07:13:06 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:03.555 07:13:06 -- common/autotest_common.sh@640 -- # local es=0 00:15:03.555 07:13:06 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:03.555 07:13:06 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.555 07:13:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:03.555 07:13:06 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.555 07:13:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:03.555 07:13:06 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.555 07:13:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:03.555 07:13:06 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:03.555 07:13:06 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:03.556 07:13:06 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:03.813 request: 00:15:03.813 { 00:15:03.814 "uuid": "50a1e813-0471-4da0-9637-1f1c4d026222", 00:15:03.814 "method": "bdev_lvol_get_lvstores", 00:15:03.814 "req_id": 1 00:15:03.814 } 00:15:03.814 Got JSON-RPC error response 00:15:03.814 response: 00:15:03.814 { 00:15:03.814 "code": -19, 00:15:03.814 "message": "No such device" 00:15:03.814 } 00:15:03.814 07:13:06 -- common/autotest_common.sh@643 -- # es=1 00:15:03.814 07:13:06 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:03.814 07:13:06 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:03.814 07:13:06 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:03.814 07:13:06 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:04.071 aio_bdev 00:15:04.071 07:13:06 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 00:15:04.071 07:13:06 -- common/autotest_common.sh@887 -- # local bdev_name=a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 00:15:04.071 07:13:06 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:04.071 07:13:06 -- common/autotest_common.sh@889 -- # local i 00:15:04.071 07:13:06 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:04.071 07:13:06 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:04.071 07:13:06 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:04.329 07:13:07 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 -t 2000 00:15:04.586 [ 00:15:04.586 { 00:15:04.586 "name": "a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9", 00:15:04.586 "aliases": [ 00:15:04.586 "lvs/lvol" 00:15:04.586 ], 00:15:04.586 "product_name": "Logical Volume", 00:15:04.586 "block_size": 4096, 00:15:04.586 "num_blocks": 38912, 00:15:04.586 "uuid": "a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9", 00:15:04.586 "assigned_rate_limits": { 00:15:04.586 "rw_ios_per_sec": 0, 00:15:04.587 "rw_mbytes_per_sec": 0, 00:15:04.587 "r_mbytes_per_sec": 0, 00:15:04.587 "w_mbytes_per_sec": 0 00:15:04.587 }, 00:15:04.587 "claimed": false, 00:15:04.587 "zoned": false, 00:15:04.587 "supported_io_types": { 00:15:04.587 "read": true, 00:15:04.587 "write": true, 00:15:04.587 "unmap": true, 00:15:04.587 "write_zeroes": true, 00:15:04.587 "flush": false, 00:15:04.587 "reset": true, 00:15:04.587 "compare": false, 00:15:04.587 "compare_and_write": false, 00:15:04.587 "abort": false, 00:15:04.587 "nvme_admin": false, 00:15:04.587 "nvme_io": false 00:15:04.587 }, 00:15:04.587 "driver_specific": { 00:15:04.587 "lvol": { 00:15:04.587 "lvol_store_uuid": "50a1e813-0471-4da0-9637-1f1c4d026222", 00:15:04.587 "base_bdev": "aio_bdev", 00:15:04.587 "thin_provision": false, 00:15:04.587 "snapshot": false, 00:15:04.587 "clone": false, 00:15:04.587 "esnap_clone": false 00:15:04.587 } 00:15:04.587 } 00:15:04.587 } 00:15:04.587 ] 00:15:04.587 07:13:07 -- common/autotest_common.sh@895 -- # return 0 00:15:04.587 07:13:07 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:04.587 07:13:07 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:04.845 07:13:07 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:04.845 07:13:07 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:04.845 07:13:07 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:05.103 07:13:07 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:05.103 07:13:07 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a69ec27c-d1d6-4ad8-b12c-7c0ea4a364f9 00:15:05.361 07:13:08 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 50a1e813-0471-4da0-9637-1f1c4d026222 00:15:05.619 07:13:08 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.877 00:15:05.877 real 0m18.246s 00:15:05.877 user 0m16.765s 00:15:05.877 sys 0m2.405s 00:15:05.877 07:13:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:05.877 07:13:08 -- common/autotest_common.sh@10 -- # set +x 00:15:05.877 ************************************ 00:15:05.877 END TEST lvs_grow_clean 00:15:05.877 ************************************ 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:05.877 07:13:08 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:05.877 07:13:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:05.877 07:13:08 -- common/autotest_common.sh@10 -- # set +x 00:15:05.877 ************************************ 00:15:05.877 START TEST lvs_grow_dirty 00:15:05.877 ************************************ 00:15:05.877 07:13:08 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:05.877 07:13:08 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:06.441 07:13:09 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:06.442 07:13:09 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:06.442 07:13:09 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:06.442 07:13:09 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:06.442 07:13:09 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:06.700 07:13:09 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:06.700 07:13:09 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:06.700 07:13:09 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d4f36034-ef49-40d0-ab4f-c274e797beb8 lvol 150 00:15:06.959 07:13:09 -- target/nvmf_lvs_grow.sh@33 -- # lvol=1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:06.959 07:13:09 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:06.959 07:13:09 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:07.215 [2024-10-16 07:13:10.141268] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:07.215 [2024-10-16 07:13:10.141350] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:07.215 true 00:15:07.472 07:13:10 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:07.472 07:13:10 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:07.731 07:13:10 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:07.731 07:13:10 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:07.989 07:13:10 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:07.989 07:13:10 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:08.248 07:13:11 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:08.506 07:13:11 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1888071 00:15:08.506 07:13:11 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:08.506 07:13:11 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:08.506 07:13:11 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1888071 /var/tmp/bdevperf.sock 00:15:08.506 07:13:11 -- common/autotest_common.sh@819 -- # '[' -z 1888071 ']' 00:15:08.506 07:13:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:08.506 07:13:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:08.506 07:13:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:08.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:08.506 07:13:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:08.506 07:13:11 -- common/autotest_common.sh@10 -- # set +x 00:15:08.764 [2024-10-16 07:13:11.464412] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:08.764 [2024-10-16 07:13:11.464490] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1888071 ] 00:15:08.764 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.764 [2024-10-16 07:13:11.532388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:08.764 [2024-10-16 07:13:11.642026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:09.698 07:13:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:09.698 07:13:12 -- common/autotest_common.sh@852 -- # return 0 00:15:09.698 07:13:12 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:09.956 Nvme0n1 00:15:09.956 07:13:12 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:10.214 [ 00:15:10.214 { 00:15:10.214 "name": "Nvme0n1", 00:15:10.214 "aliases": [ 00:15:10.214 "1152695a-00fd-4afd-bc10-cd8163c2c4e0" 00:15:10.214 ], 00:15:10.214 "product_name": "NVMe disk", 00:15:10.214 "block_size": 4096, 00:15:10.214 "num_blocks": 38912, 00:15:10.214 "uuid": "1152695a-00fd-4afd-bc10-cd8163c2c4e0", 00:15:10.214 "assigned_rate_limits": { 00:15:10.214 "rw_ios_per_sec": 0, 00:15:10.214 "rw_mbytes_per_sec": 0, 00:15:10.214 "r_mbytes_per_sec": 0, 00:15:10.214 "w_mbytes_per_sec": 0 00:15:10.214 }, 00:15:10.214 "claimed": false, 00:15:10.214 "zoned": false, 00:15:10.214 "supported_io_types": { 00:15:10.214 "read": true, 00:15:10.214 "write": true, 00:15:10.214 "unmap": true, 00:15:10.214 "write_zeroes": true, 00:15:10.214 "flush": true, 00:15:10.214 "reset": true, 00:15:10.214 "compare": true, 00:15:10.214 "compare_and_write": true, 00:15:10.214 "abort": true, 00:15:10.214 "nvme_admin": true, 00:15:10.214 "nvme_io": true 00:15:10.214 }, 00:15:10.214 "driver_specific": { 00:15:10.214 "nvme": [ 00:15:10.214 { 00:15:10.214 "trid": { 00:15:10.214 "trtype": "TCP", 00:15:10.214 "adrfam": "IPv4", 00:15:10.214 "traddr": "10.0.0.2", 00:15:10.214 "trsvcid": "4420", 00:15:10.214 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:10.214 }, 00:15:10.214 "ctrlr_data": { 00:15:10.214 "cntlid": 1, 00:15:10.214 "vendor_id": "0x8086", 00:15:10.214 "model_number": "SPDK bdev Controller", 00:15:10.214 "serial_number": "SPDK0", 00:15:10.214 "firmware_revision": "24.01.1", 00:15:10.214 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:10.214 "oacs": { 00:15:10.214 "security": 0, 00:15:10.214 "format": 0, 00:15:10.214 "firmware": 0, 00:15:10.214 "ns_manage": 0 00:15:10.214 }, 00:15:10.214 "multi_ctrlr": true, 00:15:10.214 "ana_reporting": false 00:15:10.214 }, 00:15:10.214 "vs": { 00:15:10.214 "nvme_version": "1.3" 00:15:10.214 }, 00:15:10.214 "ns_data": { 00:15:10.214 "id": 1, 00:15:10.214 "can_share": true 00:15:10.214 } 00:15:10.214 } 00:15:10.214 ], 00:15:10.214 "mp_policy": "active_passive" 00:15:10.214 } 00:15:10.214 } 00:15:10.214 ] 00:15:10.214 07:13:13 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1888340 00:15:10.214 07:13:13 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:10.214 07:13:13 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:10.472 Running I/O for 10 seconds... 00:15:11.406 Latency(us) 00:15:11.406 [2024-10-16T05:13:14.346Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:11.406 [2024-10-16T05:13:14.346Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.406 Nvme0n1 : 1.00 14993.00 58.57 0.00 0.00 0.00 0.00 0.00 00:15:11.406 [2024-10-16T05:13:14.346Z] =================================================================================================================== 00:15:11.406 [2024-10-16T05:13:14.346Z] Total : 14993.00 58.57 0.00 0.00 0.00 0.00 0.00 00:15:11.406 00:15:12.339 07:13:15 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:12.339 [2024-10-16T05:13:15.279Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:12.339 Nvme0n1 : 2.00 15087.50 58.94 0.00 0.00 0.00 0.00 0.00 00:15:12.339 [2024-10-16T05:13:15.279Z] =================================================================================================================== 00:15:12.339 [2024-10-16T05:13:15.279Z] Total : 15087.50 58.94 0.00 0.00 0.00 0.00 0.00 00:15:12.339 00:15:12.597 true 00:15:12.597 07:13:15 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:12.597 07:13:15 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:12.855 07:13:15 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:12.855 07:13:15 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:12.855 07:13:15 -- target/nvmf_lvs_grow.sh@65 -- # wait 1888340 00:15:13.420 [2024-10-16T05:13:16.360Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.420 Nvme0n1 : 3.00 15180.67 59.30 0.00 0.00 0.00 0.00 0.00 00:15:13.420 [2024-10-16T05:13:16.360Z] =================================================================================================================== 00:15:13.420 [2024-10-16T05:13:16.360Z] Total : 15180.67 59.30 0.00 0.00 0.00 0.00 0.00 00:15:13.420 00:15:14.354 [2024-10-16T05:13:17.294Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.354 Nvme0n1 : 4.00 15228.25 59.49 0.00 0.00 0.00 0.00 0.00 00:15:14.354 [2024-10-16T05:13:17.294Z] =================================================================================================================== 00:15:14.354 [2024-10-16T05:13:17.294Z] Total : 15228.25 59.49 0.00 0.00 0.00 0.00 0.00 00:15:14.354 00:15:15.728 [2024-10-16T05:13:18.668Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.728 Nvme0n1 : 5.00 15282.00 59.70 0.00 0.00 0.00 0.00 0.00 00:15:15.728 [2024-10-16T05:13:18.668Z] =================================================================================================================== 00:15:15.728 [2024-10-16T05:13:18.668Z] Total : 15282.00 59.70 0.00 0.00 0.00 0.00 0.00 00:15:15.728 00:15:16.294 [2024-10-16T05:13:19.234Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.294 Nvme0n1 : 6.00 15331.67 59.89 0.00 0.00 0.00 0.00 0.00 00:15:16.294 [2024-10-16T05:13:19.234Z] =================================================================================================================== 00:15:16.294 [2024-10-16T05:13:19.234Z] Total : 15331.67 59.89 0.00 0.00 0.00 0.00 0.00 00:15:16.294 00:15:17.669 [2024-10-16T05:13:20.609Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.669 Nvme0n1 : 7.00 15358.43 59.99 0.00 0.00 0.00 0.00 0.00 00:15:17.669 [2024-10-16T05:13:20.609Z] =================================================================================================================== 00:15:17.669 [2024-10-16T05:13:20.609Z] Total : 15358.43 59.99 0.00 0.00 0.00 0.00 0.00 00:15:17.669 00:15:18.603 [2024-10-16T05:13:21.543Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.603 Nvme0n1 : 8.00 15381.38 60.08 0.00 0.00 0.00 0.00 0.00 00:15:18.603 [2024-10-16T05:13:21.543Z] =================================================================================================================== 00:15:18.603 [2024-10-16T05:13:21.543Z] Total : 15381.38 60.08 0.00 0.00 0.00 0.00 0.00 00:15:18.603 00:15:19.537 [2024-10-16T05:13:22.477Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.537 Nvme0n1 : 9.00 15415.67 60.22 0.00 0.00 0.00 0.00 0.00 00:15:19.537 [2024-10-16T05:13:22.477Z] =================================================================================================================== 00:15:19.537 [2024-10-16T05:13:22.477Z] Total : 15415.67 60.22 0.00 0.00 0.00 0.00 0.00 00:15:19.537 00:15:20.471 [2024-10-16T05:13:23.411Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.471 Nvme0n1 : 10.00 15436.20 60.30 0.00 0.00 0.00 0.00 0.00 00:15:20.471 [2024-10-16T05:13:23.411Z] =================================================================================================================== 00:15:20.471 [2024-10-16T05:13:23.411Z] Total : 15436.20 60.30 0.00 0.00 0.00 0.00 0.00 00:15:20.471 00:15:20.471 00:15:20.471 Latency(us) 00:15:20.471 [2024-10-16T05:13:23.411Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.471 [2024-10-16T05:13:23.411Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.471 Nvme0n1 : 10.01 15439.66 60.31 0.00 0.00 8285.95 4854.52 16602.45 00:15:20.471 [2024-10-16T05:13:23.411Z] =================================================================================================================== 00:15:20.471 [2024-10-16T05:13:23.411Z] Total : 15439.66 60.31 0.00 0.00 8285.95 4854.52 16602.45 00:15:20.471 0 00:15:20.471 07:13:23 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1888071 00:15:20.471 07:13:23 -- common/autotest_common.sh@926 -- # '[' -z 1888071 ']' 00:15:20.471 07:13:23 -- common/autotest_common.sh@930 -- # kill -0 1888071 00:15:20.471 07:13:23 -- common/autotest_common.sh@931 -- # uname 00:15:20.471 07:13:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:20.471 07:13:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1888071 00:15:20.471 07:13:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:20.471 07:13:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:20.471 07:13:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1888071' 00:15:20.471 killing process with pid 1888071 00:15:20.471 07:13:23 -- common/autotest_common.sh@945 -- # kill 1888071 00:15:20.471 Received shutdown signal, test time was about 10.000000 seconds 00:15:20.471 00:15:20.471 Latency(us) 00:15:20.471 [2024-10-16T05:13:23.411Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.471 [2024-10-16T05:13:23.411Z] =================================================================================================================== 00:15:20.471 [2024-10-16T05:13:23.411Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:20.471 07:13:23 -- common/autotest_common.sh@950 -- # wait 1888071 00:15:20.729 07:13:23 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:20.987 07:13:23 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:20.987 07:13:23 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1885367 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@74 -- # wait 1885367 00:15:21.245 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1885367 Killed "${NVMF_APP[@]}" "$@" 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:21.245 07:13:24 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:21.245 07:13:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:21.245 07:13:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:21.245 07:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:21.246 07:13:24 -- nvmf/common.sh@469 -- # nvmfpid=1889702 00:15:21.246 07:13:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:21.246 07:13:24 -- nvmf/common.sh@470 -- # waitforlisten 1889702 00:15:21.246 07:13:24 -- common/autotest_common.sh@819 -- # '[' -z 1889702 ']' 00:15:21.246 07:13:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:21.246 07:13:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:21.246 07:13:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:21.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:21.246 07:13:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:21.246 07:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:21.246 [2024-10-16 07:13:24.176573] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:21.246 [2024-10-16 07:13:24.176650] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:21.504 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.504 [2024-10-16 07:13:24.244052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.504 [2024-10-16 07:13:24.353518] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:21.504 [2024-10-16 07:13:24.353656] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.504 [2024-10-16 07:13:24.353673] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.504 [2024-10-16 07:13:24.353684] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.504 [2024-10-16 07:13:24.353745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:22.438 07:13:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:22.438 07:13:25 -- common/autotest_common.sh@852 -- # return 0 00:15:22.438 07:13:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:22.438 07:13:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:22.438 07:13:25 -- common/autotest_common.sh@10 -- # set +x 00:15:22.438 07:13:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:22.438 07:13:25 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:22.696 [2024-10-16 07:13:25.405277] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:22.696 [2024-10-16 07:13:25.405431] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:22.696 [2024-10-16 07:13:25.405500] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:22.696 07:13:25 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:22.696 07:13:25 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:22.696 07:13:25 -- common/autotest_common.sh@887 -- # local bdev_name=1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:22.696 07:13:25 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:22.696 07:13:25 -- common/autotest_common.sh@889 -- # local i 00:15:22.696 07:13:25 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:22.696 07:13:25 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:22.696 07:13:25 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:22.954 07:13:25 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1152695a-00fd-4afd-bc10-cd8163c2c4e0 -t 2000 00:15:23.212 [ 00:15:23.212 { 00:15:23.212 "name": "1152695a-00fd-4afd-bc10-cd8163c2c4e0", 00:15:23.212 "aliases": [ 00:15:23.212 "lvs/lvol" 00:15:23.212 ], 00:15:23.212 "product_name": "Logical Volume", 00:15:23.212 "block_size": 4096, 00:15:23.212 "num_blocks": 38912, 00:15:23.212 "uuid": "1152695a-00fd-4afd-bc10-cd8163c2c4e0", 00:15:23.212 "assigned_rate_limits": { 00:15:23.212 "rw_ios_per_sec": 0, 00:15:23.212 "rw_mbytes_per_sec": 0, 00:15:23.212 "r_mbytes_per_sec": 0, 00:15:23.212 "w_mbytes_per_sec": 0 00:15:23.212 }, 00:15:23.212 "claimed": false, 00:15:23.212 "zoned": false, 00:15:23.212 "supported_io_types": { 00:15:23.212 "read": true, 00:15:23.212 "write": true, 00:15:23.212 "unmap": true, 00:15:23.212 "write_zeroes": true, 00:15:23.212 "flush": false, 00:15:23.212 "reset": true, 00:15:23.212 "compare": false, 00:15:23.212 "compare_and_write": false, 00:15:23.212 "abort": false, 00:15:23.212 "nvme_admin": false, 00:15:23.212 "nvme_io": false 00:15:23.212 }, 00:15:23.212 "driver_specific": { 00:15:23.212 "lvol": { 00:15:23.212 "lvol_store_uuid": "d4f36034-ef49-40d0-ab4f-c274e797beb8", 00:15:23.212 "base_bdev": "aio_bdev", 00:15:23.212 "thin_provision": false, 00:15:23.212 "snapshot": false, 00:15:23.212 "clone": false, 00:15:23.212 "esnap_clone": false 00:15:23.212 } 00:15:23.212 } 00:15:23.212 } 00:15:23.212 ] 00:15:23.212 07:13:25 -- common/autotest_common.sh@895 -- # return 0 00:15:23.212 07:13:25 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:23.212 07:13:25 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:23.471 07:13:26 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:23.471 07:13:26 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:23.471 07:13:26 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:23.729 07:13:26 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:23.729 07:13:26 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:23.987 [2024-10-16 07:13:26.686160] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:23.987 07:13:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:23.987 07:13:26 -- common/autotest_common.sh@640 -- # local es=0 00:15:23.987 07:13:26 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:23.987 07:13:26 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.987 07:13:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:23.987 07:13:26 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.987 07:13:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:23.987 07:13:26 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.987 07:13:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:23.987 07:13:26 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:23.987 07:13:26 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:23.987 07:13:26 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:24.245 request: 00:15:24.245 { 00:15:24.245 "uuid": "d4f36034-ef49-40d0-ab4f-c274e797beb8", 00:15:24.245 "method": "bdev_lvol_get_lvstores", 00:15:24.245 "req_id": 1 00:15:24.245 } 00:15:24.245 Got JSON-RPC error response 00:15:24.245 response: 00:15:24.245 { 00:15:24.245 "code": -19, 00:15:24.245 "message": "No such device" 00:15:24.245 } 00:15:24.245 07:13:27 -- common/autotest_common.sh@643 -- # es=1 00:15:24.245 07:13:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:24.245 07:13:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:24.245 07:13:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:24.245 07:13:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.503 aio_bdev 00:15:24.503 07:13:27 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:24.503 07:13:27 -- common/autotest_common.sh@887 -- # local bdev_name=1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:24.503 07:13:27 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:24.503 07:13:27 -- common/autotest_common.sh@889 -- # local i 00:15:24.503 07:13:27 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:24.503 07:13:27 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:24.503 07:13:27 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:24.760 07:13:27 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1152695a-00fd-4afd-bc10-cd8163c2c4e0 -t 2000 00:15:25.018 [ 00:15:25.018 { 00:15:25.018 "name": "1152695a-00fd-4afd-bc10-cd8163c2c4e0", 00:15:25.018 "aliases": [ 00:15:25.018 "lvs/lvol" 00:15:25.018 ], 00:15:25.018 "product_name": "Logical Volume", 00:15:25.018 "block_size": 4096, 00:15:25.018 "num_blocks": 38912, 00:15:25.018 "uuid": "1152695a-00fd-4afd-bc10-cd8163c2c4e0", 00:15:25.018 "assigned_rate_limits": { 00:15:25.018 "rw_ios_per_sec": 0, 00:15:25.018 "rw_mbytes_per_sec": 0, 00:15:25.018 "r_mbytes_per_sec": 0, 00:15:25.018 "w_mbytes_per_sec": 0 00:15:25.018 }, 00:15:25.018 "claimed": false, 00:15:25.018 "zoned": false, 00:15:25.018 "supported_io_types": { 00:15:25.018 "read": true, 00:15:25.018 "write": true, 00:15:25.018 "unmap": true, 00:15:25.018 "write_zeroes": true, 00:15:25.018 "flush": false, 00:15:25.018 "reset": true, 00:15:25.018 "compare": false, 00:15:25.018 "compare_and_write": false, 00:15:25.018 "abort": false, 00:15:25.018 "nvme_admin": false, 00:15:25.018 "nvme_io": false 00:15:25.018 }, 00:15:25.018 "driver_specific": { 00:15:25.018 "lvol": { 00:15:25.018 "lvol_store_uuid": "d4f36034-ef49-40d0-ab4f-c274e797beb8", 00:15:25.018 "base_bdev": "aio_bdev", 00:15:25.018 "thin_provision": false, 00:15:25.018 "snapshot": false, 00:15:25.018 "clone": false, 00:15:25.018 "esnap_clone": false 00:15:25.018 } 00:15:25.018 } 00:15:25.018 } 00:15:25.018 ] 00:15:25.018 07:13:27 -- common/autotest_common.sh@895 -- # return 0 00:15:25.018 07:13:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:25.018 07:13:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:25.277 07:13:28 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:25.277 07:13:28 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:25.277 07:13:28 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:25.535 07:13:28 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:25.535 07:13:28 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1152695a-00fd-4afd-bc10-cd8163c2c4e0 00:15:25.793 07:13:28 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d4f36034-ef49-40d0-ab4f-c274e797beb8 00:15:26.051 07:13:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:26.309 07:13:29 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:26.309 00:15:26.309 real 0m20.408s 00:15:26.309 user 0m51.555s 00:15:26.309 sys 0m4.736s 00:15:26.309 07:13:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:26.309 07:13:29 -- common/autotest_common.sh@10 -- # set +x 00:15:26.309 ************************************ 00:15:26.309 END TEST lvs_grow_dirty 00:15:26.309 ************************************ 00:15:26.309 07:13:29 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:26.309 07:13:29 -- common/autotest_common.sh@796 -- # type=--id 00:15:26.309 07:13:29 -- common/autotest_common.sh@797 -- # id=0 00:15:26.309 07:13:29 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:15:26.309 07:13:29 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:26.309 07:13:29 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:15:26.309 07:13:29 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:15:26.309 07:13:29 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:15:26.310 07:13:29 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:26.310 nvmf_trace.0 00:15:26.310 07:13:29 -- common/autotest_common.sh@811 -- # return 0 00:15:26.310 07:13:29 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:26.310 07:13:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.310 07:13:29 -- nvmf/common.sh@116 -- # sync 00:15:26.310 07:13:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.310 07:13:29 -- nvmf/common.sh@119 -- # set +e 00:15:26.310 07:13:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.310 07:13:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.310 rmmod nvme_tcp 00:15:26.310 rmmod nvme_fabrics 00:15:26.568 rmmod nvme_keyring 00:15:26.568 07:13:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.568 07:13:29 -- nvmf/common.sh@123 -- # set -e 00:15:26.568 07:13:29 -- nvmf/common.sh@124 -- # return 0 00:15:26.568 07:13:29 -- nvmf/common.sh@477 -- # '[' -n 1889702 ']' 00:15:26.568 07:13:29 -- nvmf/common.sh@478 -- # killprocess 1889702 00:15:26.568 07:13:29 -- common/autotest_common.sh@926 -- # '[' -z 1889702 ']' 00:15:26.568 07:13:29 -- common/autotest_common.sh@930 -- # kill -0 1889702 00:15:26.568 07:13:29 -- common/autotest_common.sh@931 -- # uname 00:15:26.568 07:13:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:26.568 07:13:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1889702 00:15:26.568 07:13:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:26.568 07:13:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:26.568 07:13:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1889702' 00:15:26.568 killing process with pid 1889702 00:15:26.568 07:13:29 -- common/autotest_common.sh@945 -- # kill 1889702 00:15:26.568 07:13:29 -- common/autotest_common.sh@950 -- # wait 1889702 00:15:26.826 07:13:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.826 07:13:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.826 07:13:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.826 07:13:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.826 07:13:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.826 07:13:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.826 07:13:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.826 07:13:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.726 07:13:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:28.726 00:15:28.726 real 0m44.829s 00:15:28.726 user 1m15.151s 00:15:28.726 sys 0m9.084s 00:15:28.726 07:13:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:28.726 07:13:31 -- common/autotest_common.sh@10 -- # set +x 00:15:28.726 ************************************ 00:15:28.726 END TEST nvmf_lvs_grow 00:15:28.726 ************************************ 00:15:28.726 07:13:31 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:28.726 07:13:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:28.726 07:13:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:28.726 07:13:31 -- common/autotest_common.sh@10 -- # set +x 00:15:28.726 ************************************ 00:15:28.726 START TEST nvmf_bdev_io_wait 00:15:28.726 ************************************ 00:15:28.726 07:13:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:28.985 * Looking for test storage... 00:15:28.985 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:28.985 07:13:31 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:28.985 07:13:31 -- nvmf/common.sh@7 -- # uname -s 00:15:28.985 07:13:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.985 07:13:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.985 07:13:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.985 07:13:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.985 07:13:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.985 07:13:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.985 07:13:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.985 07:13:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.985 07:13:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.985 07:13:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.985 07:13:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.985 07:13:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.985 07:13:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.985 07:13:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.985 07:13:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:28.985 07:13:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:28.985 07:13:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.985 07:13:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.985 07:13:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.986 07:13:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.986 07:13:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.986 07:13:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.986 07:13:31 -- paths/export.sh@5 -- # export PATH 00:15:28.986 07:13:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.986 07:13:31 -- nvmf/common.sh@46 -- # : 0 00:15:28.986 07:13:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:28.986 07:13:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:28.986 07:13:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:28.986 07:13:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.986 07:13:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.986 07:13:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:28.986 07:13:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:28.986 07:13:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:28.986 07:13:31 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:28.986 07:13:31 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:28.986 07:13:31 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:28.986 07:13:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:28.986 07:13:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:28.986 07:13:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:28.986 07:13:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:28.986 07:13:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:28.986 07:13:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.986 07:13:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.986 07:13:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.986 07:13:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:28.986 07:13:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:28.986 07:13:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:28.986 07:13:31 -- common/autotest_common.sh@10 -- # set +x 00:15:30.886 07:13:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:30.886 07:13:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:30.886 07:13:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:30.886 07:13:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:30.886 07:13:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:30.886 07:13:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:30.886 07:13:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:30.886 07:13:33 -- nvmf/common.sh@294 -- # net_devs=() 00:15:30.886 07:13:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:30.886 07:13:33 -- nvmf/common.sh@295 -- # e810=() 00:15:30.886 07:13:33 -- nvmf/common.sh@295 -- # local -ga e810 00:15:30.886 07:13:33 -- nvmf/common.sh@296 -- # x722=() 00:15:30.886 07:13:33 -- nvmf/common.sh@296 -- # local -ga x722 00:15:30.886 07:13:33 -- nvmf/common.sh@297 -- # mlx=() 00:15:30.886 07:13:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:30.886 07:13:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:30.886 07:13:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:30.886 07:13:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:30.886 07:13:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:30.886 07:13:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:30.886 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:30.886 07:13:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:30.886 07:13:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:30.886 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:30.886 07:13:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:30.886 07:13:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:30.886 07:13:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:30.886 07:13:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:30.886 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:30.886 07:13:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:30.886 07:13:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:30.886 07:13:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:30.886 07:13:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:30.886 07:13:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:30.886 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:30.886 07:13:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:30.886 07:13:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:30.886 07:13:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:30.886 07:13:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:30.886 07:13:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:30.886 07:13:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:30.886 07:13:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:30.886 07:13:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:30.886 07:13:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:30.886 07:13:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:30.886 07:13:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:30.886 07:13:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:30.886 07:13:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:30.886 07:13:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:30.886 07:13:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:30.886 07:13:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:30.886 07:13:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:31.144 07:13:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:31.144 07:13:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:31.144 07:13:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:31.144 07:13:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:31.144 07:13:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:31.144 07:13:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:31.144 07:13:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:31.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:31.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:15:31.144 00:15:31.144 --- 10.0.0.2 ping statistics --- 00:15:31.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:31.144 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:15:31.144 07:13:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:31.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:31.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:15:31.144 00:15:31.144 --- 10.0.0.1 ping statistics --- 00:15:31.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:31.144 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:15:31.144 07:13:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:31.144 07:13:33 -- nvmf/common.sh@410 -- # return 0 00:15:31.144 07:13:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:31.144 07:13:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:31.144 07:13:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:31.144 07:13:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:31.144 07:13:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:31.144 07:13:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:31.144 07:13:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:31.144 07:13:33 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:31.144 07:13:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:31.144 07:13:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:31.144 07:13:33 -- common/autotest_common.sh@10 -- # set +x 00:15:31.144 07:13:33 -- nvmf/common.sh@469 -- # nvmfpid=1892265 00:15:31.144 07:13:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:31.144 07:13:33 -- nvmf/common.sh@470 -- # waitforlisten 1892265 00:15:31.144 07:13:33 -- common/autotest_common.sh@819 -- # '[' -z 1892265 ']' 00:15:31.144 07:13:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:31.144 07:13:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:31.145 07:13:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:31.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:31.145 07:13:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:31.145 07:13:33 -- common/autotest_common.sh@10 -- # set +x 00:15:31.145 [2024-10-16 07:13:34.034881] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:31.145 [2024-10-16 07:13:34.034949] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:31.145 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.403 [2024-10-16 07:13:34.098173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:31.403 [2024-10-16 07:13:34.207760] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:31.403 [2024-10-16 07:13:34.207889] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:31.403 [2024-10-16 07:13:34.207906] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:31.403 [2024-10-16 07:13:34.207919] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:31.403 [2024-10-16 07:13:34.207977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:31.403 [2024-10-16 07:13:34.208033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:31.403 [2024-10-16 07:13:34.208055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:31.403 [2024-10-16 07:13:34.208057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:31.403 07:13:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:31.403 07:13:34 -- common/autotest_common.sh@852 -- # return 0 00:15:31.403 07:13:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:31.403 07:13:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:31.403 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.403 07:13:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:31.403 07:13:34 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:31.403 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.403 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.403 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.403 07:13:34 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:31.403 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.403 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.661 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.661 07:13:34 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:31.661 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.661 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.661 [2024-10-16 07:13:34.369706] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:31.661 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:31.662 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.662 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.662 Malloc0 00:15:31.662 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:31.662 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.662 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.662 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:31.662 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.662 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.662 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:31.662 07:13:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:31.662 07:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:31.662 [2024-10-16 07:13:34.432377] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:31.662 07:13:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1892408 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@30 -- # READ_PID=1892409 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # config=() 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1892412 00:15:31.662 07:13:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.662 { 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme$subsystem", 00:15:31.662 "trtype": "$TEST_TRANSPORT", 00:15:31.662 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "$NVMF_PORT", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.662 "hdgst": ${hdgst:-false}, 00:15:31.662 "ddgst": ${ddgst:-false} 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 } 00:15:31.662 EOF 00:15:31.662 )") 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # config=() 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.662 07:13:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1892414 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.662 { 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme$subsystem", 00:15:31.662 "trtype": "$TEST_TRANSPORT", 00:15:31.662 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "$NVMF_PORT", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.662 "hdgst": ${hdgst:-false}, 00:15:31.662 "ddgst": ${ddgst:-false} 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 } 00:15:31.662 EOF 00:15:31.662 )") 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@35 -- # sync 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # config=() 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # cat 00:15:31.662 07:13:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.662 { 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme$subsystem", 00:15:31.662 "trtype": "$TEST_TRANSPORT", 00:15:31.662 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "$NVMF_PORT", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.662 "hdgst": ${hdgst:-false}, 00:15:31.662 "ddgst": ${ddgst:-false} 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 } 00:15:31.662 EOF 00:15:31.662 )") 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # config=() 00:15:31.662 07:13:34 -- nvmf/common.sh@520 -- # local subsystem config 00:15:31.662 07:13:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # cat 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:31.662 { 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme$subsystem", 00:15:31.662 "trtype": "$TEST_TRANSPORT", 00:15:31.662 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "$NVMF_PORT", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:31.662 "hdgst": ${hdgst:-false}, 00:15:31.662 "ddgst": ${ddgst:-false} 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 } 00:15:31.662 EOF 00:15:31.662 )") 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # cat 00:15:31.662 07:13:34 -- target/bdev_io_wait.sh@37 -- # wait 1892408 00:15:31.662 07:13:34 -- nvmf/common.sh@542 -- # cat 00:15:31.662 07:13:34 -- nvmf/common.sh@544 -- # jq . 00:15:31.662 07:13:34 -- nvmf/common.sh@544 -- # jq . 00:15:31.662 07:13:34 -- nvmf/common.sh@544 -- # jq . 00:15:31.662 07:13:34 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.662 07:13:34 -- nvmf/common.sh@544 -- # jq . 00:15:31.662 07:13:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme1", 00:15:31.662 "trtype": "tcp", 00:15:31.662 "traddr": "10.0.0.2", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "4420", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.662 "hdgst": false, 00:15:31.662 "ddgst": false 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 }' 00:15:31.662 07:13:34 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.662 07:13:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme1", 00:15:31.662 "trtype": "tcp", 00:15:31.662 "traddr": "10.0.0.2", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "4420", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.662 "hdgst": false, 00:15:31.662 "ddgst": false 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 }' 00:15:31.662 07:13:34 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.662 07:13:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme1", 00:15:31.662 "trtype": "tcp", 00:15:31.662 "traddr": "10.0.0.2", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "4420", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.662 "hdgst": false, 00:15:31.662 "ddgst": false 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 }' 00:15:31.662 07:13:34 -- nvmf/common.sh@545 -- # IFS=, 00:15:31.662 07:13:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:31.662 "params": { 00:15:31.662 "name": "Nvme1", 00:15:31.662 "trtype": "tcp", 00:15:31.662 "traddr": "10.0.0.2", 00:15:31.662 "adrfam": "ipv4", 00:15:31.662 "trsvcid": "4420", 00:15:31.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:31.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:31.662 "hdgst": false, 00:15:31.662 "ddgst": false 00:15:31.662 }, 00:15:31.662 "method": "bdev_nvme_attach_controller" 00:15:31.662 }' 00:15:31.662 [2024-10-16 07:13:34.477144] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:31.662 [2024-10-16 07:13:34.477215] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:31.662 [2024-10-16 07:13:34.478030] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:31.662 [2024-10-16 07:13:34.478030] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:31.662 [2024-10-16 07:13:34.478033] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:31.662 [2024-10-16 07:13:34.478115] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-16 07:13:34.478114] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-16 07:13:34.478115] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:31.662 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:31.662 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:31.662 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.920 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.920 [2024-10-16 07:13:34.649562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:31.920 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.920 [2024-10-16 07:13:34.743339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:31.920 [2024-10-16 07:13:34.748717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:31.920 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.920 [2024-10-16 07:13:34.843940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:31.920 [2024-10-16 07:13:34.846949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.213 [2024-10-16 07:13:34.920588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.213 [2024-10-16 07:13:34.942911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:32.213 [2024-10-16 07:13:35.012457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:32.213 Running I/O for 1 seconds... 00:15:32.213 Running I/O for 1 seconds... 00:15:32.497 Running I/O for 1 seconds... 00:15:32.497 Running I/O for 1 seconds... 00:15:33.430 00:15:33.430 Latency(us) 00:15:33.430 [2024-10-16T05:13:36.370Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.430 [2024-10-16T05:13:36.370Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:33.430 Nvme1n1 : 1.00 195617.79 764.13 0.00 0.00 651.84 257.90 843.47 00:15:33.430 [2024-10-16T05:13:36.370Z] =================================================================================================================== 00:15:33.430 [2024-10-16T05:13:36.370Z] Total : 195617.79 764.13 0.00 0.00 651.84 257.90 843.47 00:15:33.430 00:15:33.430 Latency(us) 00:15:33.430 [2024-10-16T05:13:36.370Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.430 [2024-10-16T05:13:36.370Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:33.430 Nvme1n1 : 1.02 6934.15 27.09 0.00 0.00 18341.52 7573.05 27573.67 00:15:33.430 [2024-10-16T05:13:36.370Z] =================================================================================================================== 00:15:33.430 [2024-10-16T05:13:36.370Z] Total : 6934.15 27.09 0.00 0.00 18341.52 7573.05 27573.67 00:15:33.430 00:15:33.430 Latency(us) 00:15:33.430 [2024-10-16T05:13:36.370Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.430 [2024-10-16T05:13:36.370Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:33.430 Nvme1n1 : 1.01 9524.81 37.21 0.00 0.00 13369.35 9223.59 24855.13 00:15:33.430 [2024-10-16T05:13:36.370Z] =================================================================================================================== 00:15:33.430 [2024-10-16T05:13:36.370Z] Total : 9524.81 37.21 0.00 0.00 13369.35 9223.59 24855.13 00:15:33.430 00:15:33.430 Latency(us) 00:15:33.430 [2024-10-16T05:13:36.370Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:33.430 [2024-10-16T05:13:36.370Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:33.430 Nvme1n1 : 1.00 7332.78 28.64 0.00 0.00 17407.95 4538.97 44079.03 00:15:33.430 [2024-10-16T05:13:36.370Z] =================================================================================================================== 00:15:33.430 [2024-10-16T05:13:36.370Z] Total : 7332.78 28.64 0.00 0.00 17407.95 4538.97 44079.03 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@38 -- # wait 1892409 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@39 -- # wait 1892412 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@40 -- # wait 1892414 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:33.688 07:13:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:33.688 07:13:36 -- common/autotest_common.sh@10 -- # set +x 00:15:33.688 07:13:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:33.688 07:13:36 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:33.688 07:13:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:33.688 07:13:36 -- nvmf/common.sh@116 -- # sync 00:15:33.688 07:13:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:33.688 07:13:36 -- nvmf/common.sh@119 -- # set +e 00:15:33.688 07:13:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:33.688 07:13:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:33.688 rmmod nvme_tcp 00:15:33.688 rmmod nvme_fabrics 00:15:33.688 rmmod nvme_keyring 00:15:33.688 07:13:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:33.688 07:13:36 -- nvmf/common.sh@123 -- # set -e 00:15:33.688 07:13:36 -- nvmf/common.sh@124 -- # return 0 00:15:33.688 07:13:36 -- nvmf/common.sh@477 -- # '[' -n 1892265 ']' 00:15:33.688 07:13:36 -- nvmf/common.sh@478 -- # killprocess 1892265 00:15:33.688 07:13:36 -- common/autotest_common.sh@926 -- # '[' -z 1892265 ']' 00:15:33.688 07:13:36 -- common/autotest_common.sh@930 -- # kill -0 1892265 00:15:33.688 07:13:36 -- common/autotest_common.sh@931 -- # uname 00:15:33.688 07:13:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:33.688 07:13:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1892265 00:15:33.945 07:13:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:33.945 07:13:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:33.945 07:13:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1892265' 00:15:33.945 killing process with pid 1892265 00:15:33.945 07:13:36 -- common/autotest_common.sh@945 -- # kill 1892265 00:15:33.945 07:13:36 -- common/autotest_common.sh@950 -- # wait 1892265 00:15:34.204 07:13:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:34.204 07:13:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:34.204 07:13:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:34.204 07:13:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:34.204 07:13:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:34.204 07:13:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:34.204 07:13:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:34.204 07:13:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.117 07:13:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:36.118 00:15:36.118 real 0m7.310s 00:15:36.118 user 0m16.682s 00:15:36.118 sys 0m3.532s 00:15:36.118 07:13:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:36.118 07:13:38 -- common/autotest_common.sh@10 -- # set +x 00:15:36.118 ************************************ 00:15:36.118 END TEST nvmf_bdev_io_wait 00:15:36.118 ************************************ 00:15:36.118 07:13:38 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:36.118 07:13:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:36.118 07:13:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:36.118 07:13:38 -- common/autotest_common.sh@10 -- # set +x 00:15:36.118 ************************************ 00:15:36.118 START TEST nvmf_queue_depth 00:15:36.118 ************************************ 00:15:36.118 07:13:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:36.118 * Looking for test storage... 00:15:36.118 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:36.118 07:13:39 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:36.118 07:13:39 -- nvmf/common.sh@7 -- # uname -s 00:15:36.118 07:13:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:36.118 07:13:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:36.118 07:13:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:36.118 07:13:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:36.118 07:13:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:36.118 07:13:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:36.118 07:13:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:36.118 07:13:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:36.118 07:13:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:36.118 07:13:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:36.376 07:13:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:36.376 07:13:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:36.376 07:13:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:36.376 07:13:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:36.376 07:13:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:36.376 07:13:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:36.376 07:13:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:36.376 07:13:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:36.376 07:13:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:36.376 07:13:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.376 07:13:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.376 07:13:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.376 07:13:39 -- paths/export.sh@5 -- # export PATH 00:15:36.376 07:13:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.376 07:13:39 -- nvmf/common.sh@46 -- # : 0 00:15:36.376 07:13:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:36.376 07:13:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:36.376 07:13:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:36.376 07:13:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:36.376 07:13:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:36.376 07:13:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:36.376 07:13:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:36.376 07:13:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:36.376 07:13:39 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:36.376 07:13:39 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:36.376 07:13:39 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:36.376 07:13:39 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:36.376 07:13:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:36.376 07:13:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:36.376 07:13:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:36.376 07:13:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:36.376 07:13:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:36.376 07:13:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.376 07:13:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.376 07:13:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.376 07:13:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:36.376 07:13:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:36.376 07:13:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:36.376 07:13:39 -- common/autotest_common.sh@10 -- # set +x 00:15:38.280 07:13:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:38.280 07:13:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:38.280 07:13:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:38.280 07:13:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:38.280 07:13:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:38.280 07:13:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:38.280 07:13:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:38.280 07:13:40 -- nvmf/common.sh@294 -- # net_devs=() 00:15:38.280 07:13:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:38.280 07:13:40 -- nvmf/common.sh@295 -- # e810=() 00:15:38.280 07:13:40 -- nvmf/common.sh@295 -- # local -ga e810 00:15:38.280 07:13:40 -- nvmf/common.sh@296 -- # x722=() 00:15:38.280 07:13:40 -- nvmf/common.sh@296 -- # local -ga x722 00:15:38.280 07:13:40 -- nvmf/common.sh@297 -- # mlx=() 00:15:38.280 07:13:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:38.280 07:13:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:38.280 07:13:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:38.280 07:13:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:38.280 07:13:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:38.280 07:13:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.280 07:13:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:38.280 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:38.280 07:13:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.280 07:13:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:38.280 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:38.280 07:13:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.280 07:13:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.280 07:13:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.280 07:13:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:38.280 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:38.280 07:13:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.280 07:13:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.280 07:13:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.280 07:13:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.280 07:13:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:38.280 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:38.280 07:13:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.280 07:13:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:38.280 07:13:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:38.280 07:13:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:38.280 07:13:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:38.280 07:13:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:38.280 07:13:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:38.280 07:13:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:38.280 07:13:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:38.280 07:13:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:38.280 07:13:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:38.280 07:13:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:38.280 07:13:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:38.280 07:13:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:38.280 07:13:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:38.280 07:13:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:38.281 07:13:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:38.281 07:13:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:38.281 07:13:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:38.281 07:13:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:38.281 07:13:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:38.281 07:13:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:38.281 07:13:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:38.281 07:13:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:38.281 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:38.281 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:15:38.281 00:15:38.281 --- 10.0.0.2 ping statistics --- 00:15:38.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.281 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:15:38.281 07:13:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:38.281 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:38.281 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:15:38.281 00:15:38.281 --- 10.0.0.1 ping statistics --- 00:15:38.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.281 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:15:38.281 07:13:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:38.281 07:13:41 -- nvmf/common.sh@410 -- # return 0 00:15:38.281 07:13:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:38.281 07:13:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:38.281 07:13:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:38.281 07:13:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:38.281 07:13:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:38.281 07:13:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:38.281 07:13:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:38.281 07:13:41 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:38.281 07:13:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:38.281 07:13:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:38.281 07:13:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.281 07:13:41 -- nvmf/common.sh@469 -- # nvmfpid=1894648 00:15:38.281 07:13:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:38.281 07:13:41 -- nvmf/common.sh@470 -- # waitforlisten 1894648 00:15:38.281 07:13:41 -- common/autotest_common.sh@819 -- # '[' -z 1894648 ']' 00:15:38.281 07:13:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:38.281 07:13:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:38.281 07:13:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:38.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:38.281 07:13:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:38.281 07:13:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.281 [2024-10-16 07:13:41.212108] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:38.281 [2024-10-16 07:13:41.212190] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:38.540 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.540 [2024-10-16 07:13:41.279961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.540 [2024-10-16 07:13:41.389896] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:38.540 [2024-10-16 07:13:41.390061] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:38.540 [2024-10-16 07:13:41.390078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:38.540 [2024-10-16 07:13:41.390099] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:38.540 [2024-10-16 07:13:41.390140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.474 07:13:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:39.474 07:13:42 -- common/autotest_common.sh@852 -- # return 0 00:15:39.474 07:13:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:39.474 07:13:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 07:13:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:39.474 07:13:42 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:39.474 07:13:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 [2024-10-16 07:13:42.246598] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:39.474 07:13:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:39.474 07:13:42 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:39.474 07:13:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 Malloc0 00:15:39.474 07:13:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:39.474 07:13:42 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:39.474 07:13:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 07:13:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:39.474 07:13:42 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:39.474 07:13:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 07:13:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:39.474 07:13:42 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:39.474 07:13:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.474 [2024-10-16 07:13:42.304537] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:39.474 07:13:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:39.474 07:13:42 -- target/queue_depth.sh@30 -- # bdevperf_pid=1894804 00:15:39.474 07:13:42 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:39.474 07:13:42 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:39.474 07:13:42 -- target/queue_depth.sh@33 -- # waitforlisten 1894804 /var/tmp/bdevperf.sock 00:15:39.474 07:13:42 -- common/autotest_common.sh@819 -- # '[' -z 1894804 ']' 00:15:39.474 07:13:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:39.474 07:13:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:39.474 07:13:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:39.474 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:39.474 07:13:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:39.474 07:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.475 [2024-10-16 07:13:42.347199] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:39.475 [2024-10-16 07:13:42.347258] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1894804 ] 00:15:39.475 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.475 [2024-10-16 07:13:42.407958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:39.733 [2024-10-16 07:13:42.521899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.666 07:13:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:40.666 07:13:43 -- common/autotest_common.sh@852 -- # return 0 00:15:40.666 07:13:43 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:40.666 07:13:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:40.667 07:13:43 -- common/autotest_common.sh@10 -- # set +x 00:15:40.667 NVMe0n1 00:15:40.667 07:13:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:40.667 07:13:43 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:40.667 Running I/O for 10 seconds... 00:15:52.862 00:15:52.862 Latency(us) 00:15:52.862 [2024-10-16T05:13:55.802Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:52.862 [2024-10-16T05:13:55.802Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:52.862 Verification LBA range: start 0x0 length 0x4000 00:15:52.862 NVMe0n1 : 10.07 12285.82 47.99 0.00 0.00 83009.21 14757.74 62914.56 00:15:52.862 [2024-10-16T05:13:55.802Z] =================================================================================================================== 00:15:52.862 [2024-10-16T05:13:55.802Z] Total : 12285.82 47.99 0.00 0.00 83009.21 14757.74 62914.56 00:15:52.862 0 00:15:52.862 07:13:53 -- target/queue_depth.sh@39 -- # killprocess 1894804 00:15:52.862 07:13:53 -- common/autotest_common.sh@926 -- # '[' -z 1894804 ']' 00:15:52.862 07:13:53 -- common/autotest_common.sh@930 -- # kill -0 1894804 00:15:52.862 07:13:53 -- common/autotest_common.sh@931 -- # uname 00:15:52.862 07:13:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:52.862 07:13:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1894804 00:15:52.862 07:13:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:52.862 07:13:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:52.862 07:13:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1894804' 00:15:52.862 killing process with pid 1894804 00:15:52.862 07:13:53 -- common/autotest_common.sh@945 -- # kill 1894804 00:15:52.862 Received shutdown signal, test time was about 10.000000 seconds 00:15:52.862 00:15:52.862 Latency(us) 00:15:52.862 [2024-10-16T05:13:55.802Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:52.862 [2024-10-16T05:13:55.802Z] =================================================================================================================== 00:15:52.862 [2024-10-16T05:13:55.802Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:52.862 07:13:53 -- common/autotest_common.sh@950 -- # wait 1894804 00:15:52.862 07:13:53 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:52.862 07:13:53 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:52.862 07:13:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:52.862 07:13:53 -- nvmf/common.sh@116 -- # sync 00:15:52.862 07:13:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:52.862 07:13:53 -- nvmf/common.sh@119 -- # set +e 00:15:52.862 07:13:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:52.862 07:13:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:52.862 rmmod nvme_tcp 00:15:52.862 rmmod nvme_fabrics 00:15:52.862 rmmod nvme_keyring 00:15:52.862 07:13:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:52.862 07:13:53 -- nvmf/common.sh@123 -- # set -e 00:15:52.862 07:13:53 -- nvmf/common.sh@124 -- # return 0 00:15:52.862 07:13:53 -- nvmf/common.sh@477 -- # '[' -n 1894648 ']' 00:15:52.862 07:13:53 -- nvmf/common.sh@478 -- # killprocess 1894648 00:15:52.862 07:13:53 -- common/autotest_common.sh@926 -- # '[' -z 1894648 ']' 00:15:52.862 07:13:53 -- common/autotest_common.sh@930 -- # kill -0 1894648 00:15:52.862 07:13:53 -- common/autotest_common.sh@931 -- # uname 00:15:52.862 07:13:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:52.862 07:13:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1894648 00:15:52.862 07:13:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:52.862 07:13:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:52.862 07:13:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1894648' 00:15:52.862 killing process with pid 1894648 00:15:52.862 07:13:54 -- common/autotest_common.sh@945 -- # kill 1894648 00:15:52.862 07:13:54 -- common/autotest_common.sh@950 -- # wait 1894648 00:15:52.862 07:13:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:52.862 07:13:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:52.862 07:13:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:52.862 07:13:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:52.862 07:13:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:52.862 07:13:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.862 07:13:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.862 07:13:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.795 07:13:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:53.795 00:15:53.795 real 0m17.404s 00:15:53.795 user 0m25.089s 00:15:53.795 sys 0m3.105s 00:15:53.795 07:13:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:53.795 07:13:56 -- common/autotest_common.sh@10 -- # set +x 00:15:53.795 ************************************ 00:15:53.795 END TEST nvmf_queue_depth 00:15:53.795 ************************************ 00:15:53.795 07:13:56 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:53.795 07:13:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:53.795 07:13:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:53.795 07:13:56 -- common/autotest_common.sh@10 -- # set +x 00:15:53.795 ************************************ 00:15:53.795 START TEST nvmf_multipath 00:15:53.795 ************************************ 00:15:53.795 07:13:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:53.795 * Looking for test storage... 00:15:53.795 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:53.795 07:13:56 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:53.795 07:13:56 -- nvmf/common.sh@7 -- # uname -s 00:15:53.795 07:13:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:53.795 07:13:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:53.795 07:13:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:53.795 07:13:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:53.795 07:13:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:53.795 07:13:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:53.795 07:13:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:53.795 07:13:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:53.795 07:13:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:53.795 07:13:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:53.795 07:13:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.795 07:13:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.795 07:13:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:53.795 07:13:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:53.795 07:13:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:53.795 07:13:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:53.795 07:13:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:53.795 07:13:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:53.795 07:13:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:53.796 07:13:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.796 07:13:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.796 07:13:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.796 07:13:56 -- paths/export.sh@5 -- # export PATH 00:15:53.796 07:13:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.796 07:13:56 -- nvmf/common.sh@46 -- # : 0 00:15:53.796 07:13:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:53.796 07:13:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:53.796 07:13:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:53.796 07:13:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:53.796 07:13:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:53.796 07:13:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:53.796 07:13:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:53.796 07:13:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:53.796 07:13:56 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:53.796 07:13:56 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:53.796 07:13:56 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:53.796 07:13:56 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:53.796 07:13:56 -- target/multipath.sh@43 -- # nvmftestinit 00:15:53.796 07:13:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:53.796 07:13:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:53.796 07:13:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:53.796 07:13:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:53.796 07:13:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:53.796 07:13:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:53.796 07:13:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:53.796 07:13:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.796 07:13:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:53.796 07:13:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:53.796 07:13:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:53.796 07:13:56 -- common/autotest_common.sh@10 -- # set +x 00:15:55.695 07:13:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:55.695 07:13:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:55.695 07:13:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:55.695 07:13:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:55.695 07:13:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:55.695 07:13:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:55.695 07:13:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:55.695 07:13:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:55.695 07:13:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:55.695 07:13:58 -- nvmf/common.sh@295 -- # e810=() 00:15:55.695 07:13:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:55.695 07:13:58 -- nvmf/common.sh@296 -- # x722=() 00:15:55.695 07:13:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:55.695 07:13:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:55.695 07:13:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:55.695 07:13:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:55.695 07:13:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.695 07:13:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:55.695 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:55.695 07:13:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.695 07:13:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:55.695 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:55.695 07:13:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.695 07:13:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.695 07:13:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.695 07:13:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:55.695 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:55.695 07:13:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.695 07:13:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.695 07:13:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.695 07:13:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:55.695 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:55.695 07:13:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:55.695 07:13:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:55.695 07:13:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:55.695 07:13:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:55.695 07:13:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:55.695 07:13:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:55.695 07:13:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:55.695 07:13:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:55.695 07:13:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:55.695 07:13:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:55.695 07:13:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:55.695 07:13:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:55.695 07:13:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:55.695 07:13:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:55.695 07:13:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:55.695 07:13:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:55.695 07:13:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:55.695 07:13:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:55.695 07:13:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:55.695 07:13:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:55.695 07:13:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:55.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:55.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:15:55.695 00:15:55.695 --- 10.0.0.2 ping statistics --- 00:15:55.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:55.695 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:15:55.695 07:13:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:55.695 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:55.695 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:15:55.695 00:15:55.695 --- 10.0.0.1 ping statistics --- 00:15:55.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:55.695 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:15:55.695 07:13:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:55.695 07:13:58 -- nvmf/common.sh@410 -- # return 0 00:15:55.695 07:13:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:55.695 07:13:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:55.695 07:13:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:55.695 07:13:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:55.695 07:13:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:55.695 07:13:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:55.696 07:13:58 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:55.696 07:13:58 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:55.696 only one NIC for nvmf test 00:15:55.696 07:13:58 -- target/multipath.sh@47 -- # nvmftestfini 00:15:55.696 07:13:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:55.696 07:13:58 -- nvmf/common.sh@116 -- # sync 00:15:55.696 07:13:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:55.696 07:13:58 -- nvmf/common.sh@119 -- # set +e 00:15:55.696 07:13:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:55.696 07:13:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:55.696 rmmod nvme_tcp 00:15:55.696 rmmod nvme_fabrics 00:15:55.696 rmmod nvme_keyring 00:15:55.696 07:13:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:55.696 07:13:58 -- nvmf/common.sh@123 -- # set -e 00:15:55.696 07:13:58 -- nvmf/common.sh@124 -- # return 0 00:15:55.696 07:13:58 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:55.696 07:13:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:55.696 07:13:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:55.696 07:13:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:55.696 07:13:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:55.696 07:13:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:55.696 07:13:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:55.696 07:13:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:55.696 07:13:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.230 07:14:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:58.230 07:14:00 -- target/multipath.sh@48 -- # exit 0 00:15:58.230 07:14:00 -- target/multipath.sh@1 -- # nvmftestfini 00:15:58.230 07:14:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.230 07:14:00 -- nvmf/common.sh@116 -- # sync 00:15:58.230 07:14:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.230 07:14:00 -- nvmf/common.sh@119 -- # set +e 00:15:58.230 07:14:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.230 07:14:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.230 07:14:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.230 07:14:00 -- nvmf/common.sh@123 -- # set -e 00:15:58.230 07:14:00 -- nvmf/common.sh@124 -- # return 0 00:15:58.230 07:14:00 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.230 07:14:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.230 07:14:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.230 07:14:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.230 07:14:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.230 07:14:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.230 07:14:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.230 07:14:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.230 07:14:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.230 07:14:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:58.230 00:15:58.230 real 0m4.243s 00:15:58.230 user 0m0.765s 00:15:58.230 sys 0m1.472s 00:15:58.230 07:14:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:58.230 07:14:00 -- common/autotest_common.sh@10 -- # set +x 00:15:58.230 ************************************ 00:15:58.230 END TEST nvmf_multipath 00:15:58.230 ************************************ 00:15:58.230 07:14:00 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:58.230 07:14:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:58.230 07:14:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:58.230 07:14:00 -- common/autotest_common.sh@10 -- # set +x 00:15:58.230 ************************************ 00:15:58.230 START TEST nvmf_zcopy 00:15:58.230 ************************************ 00:15:58.230 07:14:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:58.230 * Looking for test storage... 00:15:58.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:58.230 07:14:00 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:58.230 07:14:00 -- nvmf/common.sh@7 -- # uname -s 00:15:58.230 07:14:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:58.230 07:14:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:58.230 07:14:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:58.230 07:14:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:58.230 07:14:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:58.230 07:14:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:58.230 07:14:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:58.230 07:14:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:58.230 07:14:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:58.230 07:14:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:58.230 07:14:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.230 07:14:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.230 07:14:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:58.230 07:14:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:58.230 07:14:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:58.230 07:14:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:58.230 07:14:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:58.230 07:14:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:58.230 07:14:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:58.230 07:14:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.230 07:14:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.231 07:14:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.231 07:14:00 -- paths/export.sh@5 -- # export PATH 00:15:58.231 07:14:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.231 07:14:00 -- nvmf/common.sh@46 -- # : 0 00:15:58.231 07:14:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:58.231 07:14:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:58.231 07:14:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:58.231 07:14:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:58.231 07:14:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:58.231 07:14:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:58.231 07:14:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:58.231 07:14:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:58.231 07:14:00 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:58.231 07:14:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:58.231 07:14:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:58.231 07:14:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:58.231 07:14:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:58.231 07:14:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:58.231 07:14:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.231 07:14:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.231 07:14:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.231 07:14:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:58.231 07:14:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:58.231 07:14:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:58.231 07:14:00 -- common/autotest_common.sh@10 -- # set +x 00:16:00.132 07:14:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:00.132 07:14:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:00.132 07:14:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:00.132 07:14:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:00.132 07:14:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:00.132 07:14:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:00.132 07:14:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:00.132 07:14:02 -- nvmf/common.sh@294 -- # net_devs=() 00:16:00.132 07:14:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:00.132 07:14:02 -- nvmf/common.sh@295 -- # e810=() 00:16:00.132 07:14:02 -- nvmf/common.sh@295 -- # local -ga e810 00:16:00.132 07:14:02 -- nvmf/common.sh@296 -- # x722=() 00:16:00.132 07:14:02 -- nvmf/common.sh@296 -- # local -ga x722 00:16:00.132 07:14:02 -- nvmf/common.sh@297 -- # mlx=() 00:16:00.132 07:14:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:00.132 07:14:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:00.132 07:14:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:00.132 07:14:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:00.132 07:14:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.132 07:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:00.132 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:00.132 07:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.132 07:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:00.132 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:00.132 07:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.132 07:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.132 07:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.132 07:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:00.132 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:00.132 07:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.132 07:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.132 07:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.132 07:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.132 07:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:00.132 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:00.132 07:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.132 07:14:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:00.132 07:14:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:00.132 07:14:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:00.132 07:14:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:00.132 07:14:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:00.132 07:14:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:00.132 07:14:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:00.132 07:14:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:00.132 07:14:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:00.132 07:14:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:00.132 07:14:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:00.132 07:14:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:00.132 07:14:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:00.132 07:14:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:00.132 07:14:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:00.132 07:14:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:00.132 07:14:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:00.132 07:14:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:00.132 07:14:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:00.132 07:14:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:00.132 07:14:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:00.132 07:14:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:00.132 07:14:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:00.132 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:00.132 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:16:00.133 00:16:00.133 --- 10.0.0.2 ping statistics --- 00:16:00.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.133 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:16:00.133 07:14:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:00.133 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:00.133 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:16:00.133 00:16:00.133 --- 10.0.0.1 ping statistics --- 00:16:00.133 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.133 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:16:00.133 07:14:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:00.133 07:14:02 -- nvmf/common.sh@410 -- # return 0 00:16:00.133 07:14:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:00.133 07:14:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:00.133 07:14:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:00.133 07:14:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:00.133 07:14:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:00.133 07:14:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:00.133 07:14:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:00.133 07:14:02 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:00.133 07:14:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:00.133 07:14:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:00.133 07:14:02 -- common/autotest_common.sh@10 -- # set +x 00:16:00.133 07:14:02 -- nvmf/common.sh@469 -- # nvmfpid=1900045 00:16:00.133 07:14:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:00.133 07:14:02 -- nvmf/common.sh@470 -- # waitforlisten 1900045 00:16:00.133 07:14:02 -- common/autotest_common.sh@819 -- # '[' -z 1900045 ']' 00:16:00.133 07:14:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:00.133 07:14:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:00.133 07:14:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:00.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:00.133 07:14:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:00.133 07:14:02 -- common/autotest_common.sh@10 -- # set +x 00:16:00.133 [2024-10-16 07:14:03.036374] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:00.133 [2024-10-16 07:14:03.036454] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:00.133 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.391 [2024-10-16 07:14:03.100776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:00.391 [2024-10-16 07:14:03.210645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:00.391 [2024-10-16 07:14:03.210834] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:00.391 [2024-10-16 07:14:03.210854] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:00.391 [2024-10-16 07:14:03.210866] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:00.391 [2024-10-16 07:14:03.210897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:01.325 07:14:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:01.325 07:14:04 -- common/autotest_common.sh@852 -- # return 0 00:16:01.325 07:14:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:01.325 07:14:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 07:14:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:01.325 07:14:04 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:01.325 07:14:04 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 [2024-10-16 07:14:04.094678] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 [2024-10-16 07:14:04.110869] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 malloc0 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:01.325 07:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:01.325 07:14:04 -- common/autotest_common.sh@10 -- # set +x 00:16:01.325 07:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:01.325 07:14:04 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:01.325 07:14:04 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:01.325 07:14:04 -- nvmf/common.sh@520 -- # config=() 00:16:01.325 07:14:04 -- nvmf/common.sh@520 -- # local subsystem config 00:16:01.325 07:14:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:01.325 07:14:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:01.325 { 00:16:01.325 "params": { 00:16:01.325 "name": "Nvme$subsystem", 00:16:01.325 "trtype": "$TEST_TRANSPORT", 00:16:01.325 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:01.325 "adrfam": "ipv4", 00:16:01.325 "trsvcid": "$NVMF_PORT", 00:16:01.325 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:01.325 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:01.325 "hdgst": ${hdgst:-false}, 00:16:01.325 "ddgst": ${ddgst:-false} 00:16:01.325 }, 00:16:01.325 "method": "bdev_nvme_attach_controller" 00:16:01.325 } 00:16:01.325 EOF 00:16:01.325 )") 00:16:01.325 07:14:04 -- nvmf/common.sh@542 -- # cat 00:16:01.325 07:14:04 -- nvmf/common.sh@544 -- # jq . 00:16:01.325 07:14:04 -- nvmf/common.sh@545 -- # IFS=, 00:16:01.325 07:14:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:01.325 "params": { 00:16:01.325 "name": "Nvme1", 00:16:01.325 "trtype": "tcp", 00:16:01.325 "traddr": "10.0.0.2", 00:16:01.325 "adrfam": "ipv4", 00:16:01.325 "trsvcid": "4420", 00:16:01.325 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:01.325 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:01.325 "hdgst": false, 00:16:01.325 "ddgst": false 00:16:01.325 }, 00:16:01.325 "method": "bdev_nvme_attach_controller" 00:16:01.325 }' 00:16:01.325 [2024-10-16 07:14:04.183281] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:01.326 [2024-10-16 07:14:04.183371] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1900210 ] 00:16:01.326 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.326 [2024-10-16 07:14:04.244273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:01.584 [2024-10-16 07:14:04.362127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:01.842 Running I/O for 10 seconds... 00:16:11.808 00:16:11.809 Latency(us) 00:16:11.809 [2024-10-16T05:14:14.749Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:11.809 [2024-10-16T05:14:14.749Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:11.809 Verification LBA range: start 0x0 length 0x1000 00:16:11.809 Nvme1n1 : 10.01 8740.26 68.28 0.00 0.00 14609.85 1723.35 22136.60 00:16:11.809 [2024-10-16T05:14:14.749Z] =================================================================================================================== 00:16:11.809 [2024-10-16T05:14:14.749Z] Total : 8740.26 68.28 0.00 0.00 14609.85 1723.35 22136.60 00:16:12.067 07:14:14 -- target/zcopy.sh@39 -- # perfpid=1901433 00:16:12.067 07:14:14 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:12.067 07:14:14 -- common/autotest_common.sh@10 -- # set +x 00:16:12.067 07:14:14 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:12.067 07:14:14 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:12.067 07:14:14 -- nvmf/common.sh@520 -- # config=() 00:16:12.067 07:14:14 -- nvmf/common.sh@520 -- # local subsystem config 00:16:12.067 07:14:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:12.067 07:14:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:12.067 { 00:16:12.067 "params": { 00:16:12.067 "name": "Nvme$subsystem", 00:16:12.067 "trtype": "$TEST_TRANSPORT", 00:16:12.067 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:12.067 "adrfam": "ipv4", 00:16:12.067 "trsvcid": "$NVMF_PORT", 00:16:12.067 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:12.067 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:12.067 "hdgst": ${hdgst:-false}, 00:16:12.067 "ddgst": ${ddgst:-false} 00:16:12.067 }, 00:16:12.067 "method": "bdev_nvme_attach_controller" 00:16:12.067 } 00:16:12.067 EOF 00:16:12.067 )") 00:16:12.067 07:14:14 -- nvmf/common.sh@542 -- # cat 00:16:12.067 [2024-10-16 07:14:14.974405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.067 [2024-10-16 07:14:14.974454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.067 07:14:14 -- nvmf/common.sh@544 -- # jq . 00:16:12.067 07:14:14 -- nvmf/common.sh@545 -- # IFS=, 00:16:12.067 07:14:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:12.067 "params": { 00:16:12.068 "name": "Nvme1", 00:16:12.068 "trtype": "tcp", 00:16:12.068 "traddr": "10.0.0.2", 00:16:12.068 "adrfam": "ipv4", 00:16:12.068 "trsvcid": "4420", 00:16:12.068 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:12.068 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:12.068 "hdgst": false, 00:16:12.068 "ddgst": false 00:16:12.068 }, 00:16:12.068 "method": "bdev_nvme_attach_controller" 00:16:12.068 }' 00:16:12.068 [2024-10-16 07:14:14.982354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.068 [2024-10-16 07:14:14.982382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.068 [2024-10-16 07:14:14.990373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.068 [2024-10-16 07:14:14.990399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.068 [2024-10-16 07:14:14.998383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.068 [2024-10-16 07:14:14.998404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.068 [2024-10-16 07:14:15.006423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.068 [2024-10-16 07:14:15.006445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.068 [2024-10-16 07:14:15.009192] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:12.068 [2024-10-16 07:14:15.009248] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1901433 ] 00:16:12.327 [2024-10-16 07:14:15.014422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.014442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.022443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.022463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.030467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.030498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.327 [2024-10-16 07:14:15.038487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.038507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.046525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.046549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.054546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.054578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.062567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.062591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.070589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.070614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.071269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:12.327 [2024-10-16 07:14:15.078646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.078685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.086669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.086706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.094663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.094688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.102678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.102705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.110703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.110740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.118721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.118757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.126751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.126798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.134806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.134833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.142844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.142877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.150830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.150853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.158840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.158862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.166851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.166873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.174877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.174900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.182895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.182918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.188699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:12.327 [2024-10-16 07:14:15.190918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.190940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.198940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.198969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.206986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.207019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.215033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.215083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.223066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.223118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.231102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.231142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.239134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.239175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.247165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.247207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.255139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.255171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.327 [2024-10-16 07:14:15.263162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.327 [2024-10-16 07:14:15.263189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.271214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.271252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.279244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.279286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.287229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.287256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.295249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.295274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.303294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.303324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.311306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.311335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.319328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.319355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.327387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.327416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.335377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.335404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.343439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.343468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.351426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.351462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.359448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.359475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.367472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.367503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 Running I/O for 5 seconds... 00:16:12.586 [2024-10-16 07:14:15.375493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.375520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.389329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.389363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.400460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.400493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.411345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.411378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.422221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.422255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.435644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.435676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.446238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.446269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.457630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.457664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.468834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.468863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.479906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.479935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.490995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.491041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.503372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.503404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.513073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.513105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.586 [2024-10-16 07:14:15.523720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.586 [2024-10-16 07:14:15.523774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.534500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.534532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.547552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.547583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.557622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.557654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.568352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.568383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.581219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.581251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.591783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.591812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.602502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.602534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.615474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.615505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.625936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.625964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.637340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.637372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.650245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.650277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.660837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.660865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.671827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.671856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.682794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.682822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.694198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.694229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.707270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.707302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.717430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.717461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.728491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.728523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.739502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.739534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.750535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.750566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.763468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.763500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.773829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.773858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.845 [2024-10-16 07:14:15.784779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.845 [2024-10-16 07:14:15.784807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.795834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.795862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.806968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.806996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.820033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.820064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.830408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.830440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.841503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.841534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.852618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.852650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.863619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.863651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.874863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.874896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.886208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.886240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.898791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.898819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.908901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.908930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.919713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.919752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.932825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.932854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.942842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.942871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.954063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.954095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.966851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.966879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.976993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.977039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.988745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.988791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:15.999725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:15.999780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:16.012638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:16.012670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:16.023077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:16.023108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.104 [2024-10-16 07:14:16.034252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.104 [2024-10-16 07:14:16.034283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.047491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.047537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.058146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.058178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.068951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.068979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.081771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.081814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.091651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.091682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.102893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.102922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.115645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.115677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.125228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.125260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.136796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.136824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.147786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.147814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.158843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.158871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.171939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.171969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.182223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.182255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.193076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.193117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.206130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.206161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.216475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.216506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.227595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.227626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.240906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.240935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.251349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.251380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.262344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.262376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.273387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.273419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.284448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.284479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.363 [2024-10-16 07:14:16.295653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.363 [2024-10-16 07:14:16.295684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.307047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.307079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.318084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.318127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.329429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.329460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.343165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.343197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.353941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.353970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.364928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.364956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.377803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.377831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.387719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.387772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.399291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.399322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.410448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.410489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.421440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.421471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.434428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.434459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.444797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.444824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.455444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.455475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.466403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.466434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.476858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.476887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.487536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.487567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.498657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.498689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.509814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.509842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.522509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.522541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.534419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.534450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.543599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.543630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.621 [2024-10-16 07:14:16.555185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.621 [2024-10-16 07:14:16.555217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.567633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.567664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.577785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.577813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.589632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.589663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.601966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.601994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.611811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.611841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.623337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.623377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.634057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.634088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.645182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.645213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.658052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.658085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.668114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.668146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.679310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.679342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.692384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.692416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.702549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.702580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.713287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.713318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.724401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.724433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.735244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.735276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.748513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.748544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.758853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.758882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.769075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.769107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.779795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.779823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.790670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.790702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.801716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.801772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.880 [2024-10-16 07:14:16.812920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.880 [2024-10-16 07:14:16.812948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.824237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.824269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.837333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.837380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.847237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.847269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.858633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.858664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.870236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.870268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.881202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.881234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.892239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.892271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.905311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.905342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.915568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.915599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.926538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.926569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.939379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.939410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.949764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.949793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.960601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.960632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.971267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.971298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.982118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.982149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:16.995076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:16.995109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.004801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:17.004830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.015333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:17.015364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.028174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:17.028206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.037679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:17.037711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.049156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.139 [2024-10-16 07:14:17.049196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.139 [2024-10-16 07:14:17.059702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.140 [2024-10-16 07:14:17.059743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.140 [2024-10-16 07:14:17.070602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.140 [2024-10-16 07:14:17.070633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.083499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.409 [2024-10-16 07:14:17.083531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.093309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.409 [2024-10-16 07:14:17.093341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.104307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.409 [2024-10-16 07:14:17.104338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.116952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.409 [2024-10-16 07:14:17.116980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.127654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.409 [2024-10-16 07:14:17.127685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.409 [2024-10-16 07:14:17.138847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.138876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.149567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.149599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.160305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.160336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.173414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.173446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.184001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.184047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.195061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.195093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.206139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.206171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.216819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.216848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.230070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.230101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.240007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.240053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.251308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.251340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.262822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.262850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.274238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.274271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.285697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.285737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.298785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.298814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.309045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.309077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.320117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.320149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.333299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.333331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.410 [2024-10-16 07:14:17.343592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.410 [2024-10-16 07:14:17.343623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.355112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.355144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.366282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.366315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.377125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.377157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.388270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.388308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.401243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.401274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.412008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.412055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.422657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.422689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.435620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.435652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.446076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.446108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.456965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.456994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.469654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.469686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.479333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.479365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.670 [2024-10-16 07:14:17.490930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.670 [2024-10-16 07:14:17.490959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.504327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.504358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.514749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.514794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.526376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.526409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.537871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.537899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.550725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.550768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.561395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.561427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.572496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.572527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.585302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.585335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.595566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.595598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.671 [2024-10-16 07:14:17.606469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.671 [2024-10-16 07:14:17.606501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.619414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.619446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.630098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.630130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.641616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.641647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.652559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.652591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.663536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.663567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.676703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.676746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.686639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.686670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.697893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.697921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.709469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.709500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.722469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.722500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.732777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.732805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.744089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.744120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.755421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.755453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.766323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.766354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.779926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.779954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.790471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.790502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.801619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.801650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.813056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.813088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.824623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.824653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.835539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.835570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.846327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.846359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.859213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.859244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.930 [2024-10-16 07:14:17.871215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.930 [2024-10-16 07:14:17.871261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.880297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.880328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.891813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.891841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.902421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.902462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.913140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.913171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.926179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.926211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.936292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.936324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.946968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.946997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.957830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.957858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.970487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.970518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.980796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.980824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:17.992097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:17.992130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.002976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.003005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.014058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.014090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.026739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.026784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.036922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.036950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.047806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.047834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.060589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.060620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.071384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.071415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.082257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.082288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.094856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.188 [2024-10-16 07:14:18.094885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.188 [2024-10-16 07:14:18.104915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.189 [2024-10-16 07:14:18.104943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.189 [2024-10-16 07:14:18.115880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.189 [2024-10-16 07:14:18.115916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.189 [2024-10-16 07:14:18.126952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.189 [2024-10-16 07:14:18.126981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.138415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.138447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.149249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.149280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.159995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.160041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.172820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.172848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.183285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.183318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.194174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.194205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.204949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.204978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.215888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.215917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.228863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.228892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.239172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.239203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.250368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.250399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.263475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.263506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.273456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.273487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.285041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.285074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.296349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.296380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.309402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.309433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.319872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.319900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.330930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.330966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.342072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.342104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.353203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.353235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.366480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.366512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.377002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.377048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.447 [2024-10-16 07:14:18.388580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.447 [2024-10-16 07:14:18.388611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.399102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.399133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.409830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.409859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.420870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.420899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.433448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.433479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.443577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.443608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.454910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.454938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.467963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.467994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.478462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.478493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.489218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.489250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.500296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.500329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.511029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.511061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.521816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.521847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.532990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.533022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.545875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.545916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.555981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.556017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.568034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.568066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.579689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.579720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.592120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.592151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.602289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.602321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.613601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.613633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.624829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.624861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.635946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.635979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.705 [2024-10-16 07:14:18.647137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.705 [2024-10-16 07:14:18.647169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.659750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.659780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.669787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.669818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.681098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.681130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.692146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.692178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.703037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.703069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.714277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.714309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.725322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.725354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.736574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.736605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.749505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.749536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.759536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.759577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.771032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.771064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.782110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.782141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.793053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.793084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.806399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.806431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.964 [2024-10-16 07:14:18.816792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.964 [2024-10-16 07:14:18.816823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.828339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.828370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.839788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.839820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.851151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.851183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.864335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.864367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.875367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.875399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.886448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.886479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.965 [2024-10-16 07:14:18.897524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.965 [2024-10-16 07:14:18.897556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.908606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.908637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.919754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.919785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.930649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.930681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.943825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.943857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.954340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.954371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.965083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.236 [2024-10-16 07:14:18.965114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.236 [2024-10-16 07:14:18.976207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:18.976239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:18.987524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:18.987555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:18.998539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:18.998570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.011676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.011708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.022139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.022170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.032982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.033013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.044290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.044321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.055916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.055947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.067146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.067177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.080509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.080541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.091020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.091051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.237 [2024-10-16 07:14:19.102482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.237 [2024-10-16 07:14:19.102514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.113628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.113660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.126565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.126597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.136215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.136247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.148047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.148079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.159157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.159189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.238 [2024-10-16 07:14:19.170577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.238 [2024-10-16 07:14:19.170608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.181663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.181693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.194303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.194334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.204347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.204379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.215147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.215178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.227511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.227543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.237027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.237059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.248324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.248355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.259229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.259261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.270165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.270197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.282762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.282792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.292463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.292494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.303865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.303896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.314409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.314440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.325091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.325122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.337890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.337921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.347352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.347383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.358918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.358950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.370216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.370248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.381143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.381175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.393941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.393973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.404557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.404589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.415438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.415469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.427575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.427607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.499 [2024-10-16 07:14:19.437612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.499 [2024-10-16 07:14:19.437644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.449232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.449264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.460085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.460115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.471530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.471561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.482249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.482280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.495199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.495230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.505118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.505149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.516757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.516789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.527559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.527590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.537978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.538010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.548927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.548958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.559920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.559951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.571001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.571032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.583650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.583681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.593664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.593695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.604380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.604420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.616859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.616890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.627205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.627236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.758 [2024-10-16 07:14:19.637898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.758 [2024-10-16 07:14:19.637931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.759 [2024-10-16 07:14:19.649262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.759 [2024-10-16 07:14:19.649294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.759 [2024-10-16 07:14:19.660333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.759 [2024-10-16 07:14:19.660365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.759 [2024-10-16 07:14:19.671089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.759 [2024-10-16 07:14:19.671121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.759 [2024-10-16 07:14:19.681544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.759 [2024-10-16 07:14:19.681576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.759 [2024-10-16 07:14:19.692760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.759 [2024-10-16 07:14:19.692791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.705526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.705558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.715147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.715179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.726757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.726788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.739453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.739484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.749868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.749900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.760796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.760827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.772161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.772193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.783901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.783945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.794501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.794533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.805960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.806000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.817024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.817065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.827794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.827826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.838882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.838914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.851984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.852015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.862471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.862503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.873453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.873485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.886519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.886550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.896925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.896957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.908054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.908085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.921004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.921035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.931528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.931560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.942568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.942600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.018 [2024-10-16 07:14:19.955671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.018 [2024-10-16 07:14:19.955703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:19.966070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:19.966102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:19.976824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:19.976856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:19.989303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:19.989334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:19.998758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:19.998789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.011143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.011179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.021832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.021864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.034183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.034232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.045572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.045604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.058591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.058623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.069317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.069348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.080133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.080164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.093046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.093078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.103235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.103267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.114165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.114197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.127495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.127526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.137640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.137671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.148328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.148359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.161204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.161236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.170697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.170737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.182169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.182200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.192713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.192754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.203961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.203993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.277 [2024-10-16 07:14:20.216885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.277 [2024-10-16 07:14:20.216916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.226803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.226835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.237748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.237780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.248415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.248463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.259570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.259601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.270509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.270540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.281234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.281265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.292388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.292420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.303386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.303417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.316852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.316884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.327437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.327469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.338641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.338672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.351545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.351576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.361632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.361663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.372856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.372887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.384663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.384694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.394413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.394443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 00:16:17.536 Latency(us) 00:16:17.536 [2024-10-16T05:14:20.476Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:17.536 [2024-10-16T05:14:20.476Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:17.536 Nvme1n1 : 5.01 11542.43 90.18 0.00 0.00 11074.61 4927.34 22913.33 00:16:17.536 [2024-10-16T05:14:20.476Z] =================================================================================================================== 00:16:17.536 [2024-10-16T05:14:20.476Z] Total : 11542.43 90.18 0.00 0.00 11074.61 4927.34 22913.33 00:16:17.536 [2024-10-16 07:14:20.398988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.399018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.407050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.407079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.415032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.415060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.423089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.423131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.435181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.435243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.443167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.443214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.451195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.451242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.459208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.459256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.467276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.467328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.536 [2024-10-16 07:14:20.475256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.536 [2024-10-16 07:14:20.475302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.483280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.483327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.491304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.491353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.499333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.499385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.507355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.507405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.515370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.515416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.523387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.523433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.531412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.531456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.539434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.539481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.547421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.547454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.555422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.555448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.563443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.563468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.571493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.571521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.579493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.579520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.587551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.587591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.595585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.595630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.603620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.603669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.611579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.611604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.619600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.619625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.627623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.627648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.635646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.635671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.643672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.643699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.651774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.651821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.659780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.659826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.667746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.667771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.675770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.675794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 [2024-10-16 07:14:20.683789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.794 [2024-10-16 07:14:20.683815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.794 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1901433) - No such process 00:16:17.794 07:14:20 -- target/zcopy.sh@49 -- # wait 1901433 00:16:17.794 07:14:20 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:17.794 07:14:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:17.794 07:14:20 -- common/autotest_common.sh@10 -- # set +x 00:16:17.794 07:14:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:17.794 07:14:20 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:17.794 07:14:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:17.794 07:14:20 -- common/autotest_common.sh@10 -- # set +x 00:16:17.794 delay0 00:16:17.794 07:14:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:17.794 07:14:20 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:17.794 07:14:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:17.794 07:14:20 -- common/autotest_common.sh@10 -- # set +x 00:16:17.794 07:14:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:17.794 07:14:20 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:18.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.051 [2024-10-16 07:14:20.765037] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:24.666 Initializing NVMe Controllers 00:16:24.666 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:24.666 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:24.666 Initialization complete. Launching workers. 00:16:24.666 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 105 00:16:24.666 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 392, failed to submit 33 00:16:24.666 success 246, unsuccess 146, failed 0 00:16:24.666 07:14:26 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:24.666 07:14:26 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:24.666 07:14:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:24.666 07:14:26 -- nvmf/common.sh@116 -- # sync 00:16:24.666 07:14:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:24.666 07:14:26 -- nvmf/common.sh@119 -- # set +e 00:16:24.666 07:14:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:24.667 07:14:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:24.667 rmmod nvme_tcp 00:16:24.667 rmmod nvme_fabrics 00:16:24.667 rmmod nvme_keyring 00:16:24.667 07:14:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:24.667 07:14:26 -- nvmf/common.sh@123 -- # set -e 00:16:24.667 07:14:26 -- nvmf/common.sh@124 -- # return 0 00:16:24.667 07:14:26 -- nvmf/common.sh@477 -- # '[' -n 1900045 ']' 00:16:24.667 07:14:26 -- nvmf/common.sh@478 -- # killprocess 1900045 00:16:24.667 07:14:26 -- common/autotest_common.sh@926 -- # '[' -z 1900045 ']' 00:16:24.667 07:14:26 -- common/autotest_common.sh@930 -- # kill -0 1900045 00:16:24.667 07:14:26 -- common/autotest_common.sh@931 -- # uname 00:16:24.667 07:14:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:24.667 07:14:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1900045 00:16:24.667 07:14:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:24.667 07:14:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:24.667 07:14:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1900045' 00:16:24.667 killing process with pid 1900045 00:16:24.667 07:14:26 -- common/autotest_common.sh@945 -- # kill 1900045 00:16:24.667 07:14:26 -- common/autotest_common.sh@950 -- # wait 1900045 00:16:24.667 07:14:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:24.667 07:14:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:24.667 07:14:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:24.667 07:14:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:24.667 07:14:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:24.667 07:14:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.667 07:14:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.667 07:14:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.573 07:14:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:26.573 00:16:26.573 real 0m28.601s 00:16:26.573 user 0m42.074s 00:16:26.573 sys 0m8.058s 00:16:26.573 07:14:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:26.573 07:14:29 -- common/autotest_common.sh@10 -- # set +x 00:16:26.573 ************************************ 00:16:26.573 END TEST nvmf_zcopy 00:16:26.573 ************************************ 00:16:26.573 07:14:29 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:26.573 07:14:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:26.573 07:14:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:26.573 07:14:29 -- common/autotest_common.sh@10 -- # set +x 00:16:26.573 ************************************ 00:16:26.573 START TEST nvmf_nmic 00:16:26.573 ************************************ 00:16:26.573 07:14:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:26.573 * Looking for test storage... 00:16:26.573 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:26.573 07:14:29 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.573 07:14:29 -- nvmf/common.sh@7 -- # uname -s 00:16:26.573 07:14:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.573 07:14:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.573 07:14:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.573 07:14:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.573 07:14:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.573 07:14:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.573 07:14:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.573 07:14:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.573 07:14:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.573 07:14:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.573 07:14:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.573 07:14:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.573 07:14:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.573 07:14:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.573 07:14:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.573 07:14:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:26.573 07:14:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.573 07:14:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.573 07:14:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.573 07:14:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.573 07:14:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.573 07:14:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.573 07:14:29 -- paths/export.sh@5 -- # export PATH 00:16:26.573 07:14:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.573 07:14:29 -- nvmf/common.sh@46 -- # : 0 00:16:26.573 07:14:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:26.573 07:14:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:26.574 07:14:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:26.574 07:14:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.574 07:14:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.574 07:14:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:26.574 07:14:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:26.574 07:14:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:26.574 07:14:29 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:26.574 07:14:29 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:26.574 07:14:29 -- target/nmic.sh@14 -- # nvmftestinit 00:16:26.574 07:14:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:26.574 07:14:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.574 07:14:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:26.574 07:14:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:26.574 07:14:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:26.574 07:14:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.574 07:14:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.574 07:14:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.574 07:14:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:26.574 07:14:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:26.574 07:14:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:26.574 07:14:29 -- common/autotest_common.sh@10 -- # set +x 00:16:29.104 07:14:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.105 07:14:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:29.105 07:14:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:29.105 07:14:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:29.105 07:14:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:29.105 07:14:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:29.105 07:14:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:29.105 07:14:31 -- nvmf/common.sh@294 -- # net_devs=() 00:16:29.105 07:14:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:29.105 07:14:31 -- nvmf/common.sh@295 -- # e810=() 00:16:29.105 07:14:31 -- nvmf/common.sh@295 -- # local -ga e810 00:16:29.105 07:14:31 -- nvmf/common.sh@296 -- # x722=() 00:16:29.105 07:14:31 -- nvmf/common.sh@296 -- # local -ga x722 00:16:29.105 07:14:31 -- nvmf/common.sh@297 -- # mlx=() 00:16:29.105 07:14:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:29.105 07:14:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.105 07:14:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.105 07:14:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:29.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:29.105 07:14:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.105 07:14:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:29.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:29.105 07:14:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.105 07:14:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.105 07:14:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.105 07:14:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:29.105 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:29.105 07:14:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.105 07:14:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.105 07:14:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.105 07:14:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:29.105 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:29.105 07:14:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:29.105 07:14:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:29.105 07:14:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:29.105 07:14:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:29.105 07:14:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:29.105 07:14:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:29.105 07:14:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:29.105 07:14:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:29.105 07:14:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:29.105 07:14:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:29.105 07:14:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:29.105 07:14:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:29.105 07:14:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:29.105 07:14:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:29.105 07:14:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:29.105 07:14:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:29.105 07:14:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:29.105 07:14:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:29.105 07:14:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:29.105 07:14:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:29.105 07:14:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:29.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:29.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:16:29.105 00:16:29.105 --- 10.0.0.2 ping statistics --- 00:16:29.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.105 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:16:29.105 07:14:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:29.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:29.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:16:29.105 00:16:29.105 --- 10.0.0.1 ping statistics --- 00:16:29.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.105 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:16:29.105 07:14:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:29.105 07:14:31 -- nvmf/common.sh@410 -- # return 0 00:16:29.105 07:14:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:29.105 07:14:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:29.105 07:14:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:29.105 07:14:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:29.105 07:14:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:29.105 07:14:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:29.105 07:14:31 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:29.105 07:14:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:29.105 07:14:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:29.105 07:14:31 -- common/autotest_common.sh@10 -- # set +x 00:16:29.105 07:14:31 -- nvmf/common.sh@469 -- # nvmfpid=1904875 00:16:29.105 07:14:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:29.105 07:14:31 -- nvmf/common.sh@470 -- # waitforlisten 1904875 00:16:29.105 07:14:31 -- common/autotest_common.sh@819 -- # '[' -z 1904875 ']' 00:16:29.105 07:14:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.105 07:14:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:29.105 07:14:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.105 07:14:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:29.105 07:14:31 -- common/autotest_common.sh@10 -- # set +x 00:16:29.105 [2024-10-16 07:14:31.648283] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:29.105 [2024-10-16 07:14:31.648348] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.105 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.105 [2024-10-16 07:14:31.711935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:29.105 [2024-10-16 07:14:31.818363] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.105 [2024-10-16 07:14:31.818511] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.105 [2024-10-16 07:14:31.818528] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.105 [2024-10-16 07:14:31.818540] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.105 [2024-10-16 07:14:31.818591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.105 [2024-10-16 07:14:31.818648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.105 [2024-10-16 07:14:31.818715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:29.105 [2024-10-16 07:14:31.818717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:29.671 07:14:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:29.671 07:14:32 -- common/autotest_common.sh@852 -- # return 0 00:16:29.671 07:14:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:29.671 07:14:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:29.671 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 07:14:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:29.929 07:14:32 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 [2024-10-16 07:14:32.641329] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 Malloc0 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 [2024-10-16 07:14:32.694817] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:29.929 test case1: single bdev can't be used in multiple subsystems 00:16:29.929 07:14:32 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@28 -- # nmic_status=0 00:16:29.929 07:14:32 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 [2024-10-16 07:14:32.718643] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:29.929 [2024-10-16 07:14:32.718673] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:29.929 [2024-10-16 07:14:32.718687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:29.929 request: 00:16:29.929 { 00:16:29.929 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:29.929 "namespace": { 00:16:29.929 "bdev_name": "Malloc0" 00:16:29.929 }, 00:16:29.929 "method": "nvmf_subsystem_add_ns", 00:16:29.929 "req_id": 1 00:16:29.929 } 00:16:29.929 Got JSON-RPC error response 00:16:29.929 response: 00:16:29.929 { 00:16:29.929 "code": -32602, 00:16:29.929 "message": "Invalid parameters" 00:16:29.929 } 00:16:29.929 07:14:32 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:16:29.929 07:14:32 -- target/nmic.sh@29 -- # nmic_status=1 00:16:29.929 07:14:32 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:29.929 07:14:32 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:29.929 Adding namespace failed - expected result. 00:16:29.929 07:14:32 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:29.929 test case2: host connect to nvmf target in multiple paths 00:16:29.929 07:14:32 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:29.929 07:14:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.929 07:14:32 -- common/autotest_common.sh@10 -- # set +x 00:16:29.929 [2024-10-16 07:14:32.726780] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:29.930 07:14:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.930 07:14:32 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:30.495 07:14:33 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:31.429 07:14:34 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:31.429 07:14:34 -- common/autotest_common.sh@1177 -- # local i=0 00:16:31.429 07:14:34 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:31.429 07:14:34 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:16:31.429 07:14:34 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:33.327 07:14:36 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:33.327 07:14:36 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:33.327 07:14:36 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:33.327 07:14:36 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:16:33.327 07:14:36 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:33.327 07:14:36 -- common/autotest_common.sh@1187 -- # return 0 00:16:33.327 07:14:36 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:33.327 [global] 00:16:33.327 thread=1 00:16:33.327 invalidate=1 00:16:33.327 rw=write 00:16:33.327 time_based=1 00:16:33.327 runtime=1 00:16:33.327 ioengine=libaio 00:16:33.327 direct=1 00:16:33.327 bs=4096 00:16:33.327 iodepth=1 00:16:33.327 norandommap=0 00:16:33.327 numjobs=1 00:16:33.327 00:16:33.327 verify_dump=1 00:16:33.327 verify_backlog=512 00:16:33.327 verify_state_save=0 00:16:33.327 do_verify=1 00:16:33.327 verify=crc32c-intel 00:16:33.327 [job0] 00:16:33.327 filename=/dev/nvme0n1 00:16:33.327 Could not set queue depth (nvme0n1) 00:16:33.584 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:33.584 fio-3.35 00:16:33.584 Starting 1 thread 00:16:34.970 00:16:34.970 job0: (groupid=0, jobs=1): err= 0: pid=1905528: Wed Oct 16 07:14:37 2024 00:16:34.970 read: IOPS=21, BW=87.4KiB/s (89.5kB/s)(88.0KiB/1007msec) 00:16:34.970 slat (nsec): min=15667, max=42711, avg=29692.50, stdev=8391.63 00:16:34.970 clat (usec): min=40808, max=41025, avg=40952.99, stdev=42.32 00:16:34.970 lat (usec): min=40826, max=41041, avg=40982.68, stdev=41.52 00:16:34.970 clat percentiles (usec): 00:16:34.970 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:34.970 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:34.970 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:34.970 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:34.970 | 99.99th=[41157] 00:16:34.970 write: IOPS=508, BW=2034KiB/s (2083kB/s)(2048KiB/1007msec); 0 zone resets 00:16:34.970 slat (nsec): min=6668, max=49237, avg=13744.90, stdev=6676.60 00:16:34.970 clat (usec): min=155, max=342, avg=188.52, stdev=19.90 00:16:34.970 lat (usec): min=162, max=353, avg=202.27, stdev=24.45 00:16:34.970 clat percentiles (usec): 00:16:34.970 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 165], 20.00th=[ 169], 00:16:34.970 | 30.00th=[ 176], 40.00th=[ 182], 50.00th=[ 190], 60.00th=[ 194], 00:16:34.970 | 70.00th=[ 198], 80.00th=[ 204], 90.00th=[ 212], 95.00th=[ 221], 00:16:34.970 | 99.00th=[ 235], 99.50th=[ 269], 99.90th=[ 343], 99.95th=[ 343], 00:16:34.970 | 99.99th=[ 343] 00:16:34.970 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:34.970 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:34.970 lat (usec) : 250=95.32%, 500=0.56% 00:16:34.970 lat (msec) : 50=4.12% 00:16:34.970 cpu : usr=0.30%, sys=1.19%, ctx=534, majf=0, minf=1 00:16:34.970 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:34.970 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:34.971 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:34.971 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:34.971 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:34.971 00:16:34.971 Run status group 0 (all jobs): 00:16:34.971 READ: bw=87.4KiB/s (89.5kB/s), 87.4KiB/s-87.4KiB/s (89.5kB/s-89.5kB/s), io=88.0KiB (90.1kB), run=1007-1007msec 00:16:34.971 WRITE: bw=2034KiB/s (2083kB/s), 2034KiB/s-2034KiB/s (2083kB/s-2083kB/s), io=2048KiB (2097kB), run=1007-1007msec 00:16:34.971 00:16:34.971 Disk stats (read/write): 00:16:34.971 nvme0n1: ios=69/512, merge=0/0, ticks=806/95, in_queue=901, util=91.48% 00:16:34.971 07:14:37 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:34.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:34.971 07:14:37 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:34.971 07:14:37 -- common/autotest_common.sh@1198 -- # local i=0 00:16:34.971 07:14:37 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:34.971 07:14:37 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:34.971 07:14:37 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:34.971 07:14:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:34.971 07:14:37 -- common/autotest_common.sh@1210 -- # return 0 00:16:34.971 07:14:37 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:34.971 07:14:37 -- target/nmic.sh@53 -- # nvmftestfini 00:16:34.971 07:14:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:34.971 07:14:37 -- nvmf/common.sh@116 -- # sync 00:16:34.971 07:14:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:34.971 07:14:37 -- nvmf/common.sh@119 -- # set +e 00:16:34.971 07:14:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:34.971 07:14:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:34.971 rmmod nvme_tcp 00:16:34.971 rmmod nvme_fabrics 00:16:34.971 rmmod nvme_keyring 00:16:34.971 07:14:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:34.971 07:14:37 -- nvmf/common.sh@123 -- # set -e 00:16:34.971 07:14:37 -- nvmf/common.sh@124 -- # return 0 00:16:34.971 07:14:37 -- nvmf/common.sh@477 -- # '[' -n 1904875 ']' 00:16:34.971 07:14:37 -- nvmf/common.sh@478 -- # killprocess 1904875 00:16:34.971 07:14:37 -- common/autotest_common.sh@926 -- # '[' -z 1904875 ']' 00:16:34.971 07:14:37 -- common/autotest_common.sh@930 -- # kill -0 1904875 00:16:34.971 07:14:37 -- common/autotest_common.sh@931 -- # uname 00:16:34.971 07:14:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:34.971 07:14:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1904875 00:16:34.971 07:14:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:34.971 07:14:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:34.971 07:14:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1904875' 00:16:34.971 killing process with pid 1904875 00:16:34.971 07:14:37 -- common/autotest_common.sh@945 -- # kill 1904875 00:16:34.971 07:14:37 -- common/autotest_common.sh@950 -- # wait 1904875 00:16:35.229 07:14:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:35.229 07:14:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:35.229 07:14:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:35.229 07:14:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:35.229 07:14:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:35.229 07:14:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:35.229 07:14:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:35.229 07:14:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:37.131 07:14:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:37.131 00:16:37.131 real 0m10.700s 00:16:37.131 user 0m25.427s 00:16:37.131 sys 0m2.394s 00:16:37.131 07:14:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:37.131 07:14:40 -- common/autotest_common.sh@10 -- # set +x 00:16:37.131 ************************************ 00:16:37.131 END TEST nvmf_nmic 00:16:37.131 ************************************ 00:16:37.131 07:14:40 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:37.131 07:14:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:37.131 07:14:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:37.131 07:14:40 -- common/autotest_common.sh@10 -- # set +x 00:16:37.131 ************************************ 00:16:37.131 START TEST nvmf_fio_target 00:16:37.131 ************************************ 00:16:37.131 07:14:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:37.390 * Looking for test storage... 00:16:37.390 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:37.390 07:14:40 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:37.390 07:14:40 -- nvmf/common.sh@7 -- # uname -s 00:16:37.390 07:14:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:37.390 07:14:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:37.390 07:14:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:37.390 07:14:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:37.390 07:14:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:37.390 07:14:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:37.390 07:14:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:37.390 07:14:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:37.390 07:14:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:37.390 07:14:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:37.390 07:14:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:37.390 07:14:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:37.390 07:14:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:37.390 07:14:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:37.390 07:14:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:37.390 07:14:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:37.390 07:14:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:37.390 07:14:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:37.390 07:14:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:37.390 07:14:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.390 07:14:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.390 07:14:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.390 07:14:40 -- paths/export.sh@5 -- # export PATH 00:16:37.390 07:14:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.390 07:14:40 -- nvmf/common.sh@46 -- # : 0 00:16:37.390 07:14:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:37.390 07:14:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:37.390 07:14:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:37.390 07:14:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:37.390 07:14:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:37.390 07:14:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:37.390 07:14:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:37.390 07:14:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:37.390 07:14:40 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:37.390 07:14:40 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:37.390 07:14:40 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:37.390 07:14:40 -- target/fio.sh@16 -- # nvmftestinit 00:16:37.390 07:14:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:37.390 07:14:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:37.390 07:14:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:37.390 07:14:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:37.390 07:14:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:37.390 07:14:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:37.390 07:14:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:37.390 07:14:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:37.390 07:14:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:37.390 07:14:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:37.390 07:14:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:37.390 07:14:40 -- common/autotest_common.sh@10 -- # set +x 00:16:39.290 07:14:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:39.290 07:14:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:39.290 07:14:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:39.290 07:14:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:39.290 07:14:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:39.290 07:14:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:39.290 07:14:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:39.290 07:14:42 -- nvmf/common.sh@294 -- # net_devs=() 00:16:39.290 07:14:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:39.290 07:14:42 -- nvmf/common.sh@295 -- # e810=() 00:16:39.290 07:14:42 -- nvmf/common.sh@295 -- # local -ga e810 00:16:39.290 07:14:42 -- nvmf/common.sh@296 -- # x722=() 00:16:39.290 07:14:42 -- nvmf/common.sh@296 -- # local -ga x722 00:16:39.290 07:14:42 -- nvmf/common.sh@297 -- # mlx=() 00:16:39.290 07:14:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:39.290 07:14:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:39.290 07:14:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:39.291 07:14:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:39.291 07:14:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:39.291 07:14:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:39.291 07:14:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:39.291 07:14:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:39.291 07:14:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:39.291 07:14:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:39.291 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:39.291 07:14:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:39.291 07:14:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:39.291 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:39.291 07:14:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:39.291 07:14:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:39.291 07:14:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:39.291 07:14:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:39.291 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:39.291 07:14:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:39.291 07:14:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:39.291 07:14:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:39.291 07:14:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:39.291 07:14:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:39.291 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:39.291 07:14:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:39.291 07:14:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:39.291 07:14:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:39.291 07:14:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:39.291 07:14:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:39.291 07:14:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:39.291 07:14:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:39.291 07:14:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:39.291 07:14:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:39.291 07:14:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:39.291 07:14:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:39.291 07:14:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:39.291 07:14:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:39.291 07:14:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:39.291 07:14:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:39.291 07:14:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:39.291 07:14:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:39.291 07:14:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:39.291 07:14:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:39.291 07:14:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:39.291 07:14:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:39.549 07:14:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:39.549 07:14:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:39.549 07:14:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:39.549 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:39.549 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:16:39.549 00:16:39.549 --- 10.0.0.2 ping statistics --- 00:16:39.549 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:39.549 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:16:39.549 07:14:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:39.549 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:39.549 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:16:39.549 00:16:39.549 --- 10.0.0.1 ping statistics --- 00:16:39.549 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:39.549 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:16:39.549 07:14:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:39.549 07:14:42 -- nvmf/common.sh@410 -- # return 0 00:16:39.549 07:14:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:39.549 07:14:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:39.549 07:14:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:39.549 07:14:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:39.549 07:14:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:39.549 07:14:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:39.549 07:14:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:39.549 07:14:42 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:39.549 07:14:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:39.549 07:14:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:39.549 07:14:42 -- common/autotest_common.sh@10 -- # set +x 00:16:39.549 07:14:42 -- nvmf/common.sh@469 -- # nvmfpid=1907614 00:16:39.549 07:14:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:39.549 07:14:42 -- nvmf/common.sh@470 -- # waitforlisten 1907614 00:16:39.549 07:14:42 -- common/autotest_common.sh@819 -- # '[' -z 1907614 ']' 00:16:39.549 07:14:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:39.549 07:14:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:39.549 07:14:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:39.549 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:39.549 07:14:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:39.549 07:14:42 -- common/autotest_common.sh@10 -- # set +x 00:16:39.549 [2024-10-16 07:14:42.339261] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:39.549 [2024-10-16 07:14:42.339326] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:39.549 EAL: No free 2048 kB hugepages reported on node 1 00:16:39.549 [2024-10-16 07:14:42.400665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:39.807 [2024-10-16 07:14:42.513342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:39.807 [2024-10-16 07:14:42.513495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:39.807 [2024-10-16 07:14:42.513515] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:39.807 [2024-10-16 07:14:42.513529] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:39.807 [2024-10-16 07:14:42.513925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:39.807 [2024-10-16 07:14:42.514179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:39.807 [2024-10-16 07:14:42.514251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:39.807 [2024-10-16 07:14:42.514254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:40.740 07:14:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:40.740 07:14:43 -- common/autotest_common.sh@852 -- # return 0 00:16:40.740 07:14:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:40.740 07:14:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:40.740 07:14:43 -- common/autotest_common.sh@10 -- # set +x 00:16:40.740 07:14:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:40.740 07:14:43 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:40.740 [2024-10-16 07:14:43.634404] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:40.740 07:14:43 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.305 07:14:43 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:41.305 07:14:43 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.305 07:14:44 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:41.305 07:14:44 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.563 07:14:44 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:41.563 07:14:44 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:41.821 07:14:44 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:41.821 07:14:44 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:42.078 07:14:44 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:42.336 07:14:45 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:42.336 07:14:45 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:42.593 07:14:45 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:42.593 07:14:45 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:42.851 07:14:45 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:42.851 07:14:45 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:43.416 07:14:46 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:43.416 07:14:46 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:43.416 07:14:46 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:43.673 07:14:46 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:43.673 07:14:46 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:43.931 07:14:46 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:44.189 [2024-10-16 07:14:47.044680] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:44.189 07:14:47 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:44.454 07:14:47 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:44.717 07:14:47 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:45.652 07:14:48 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:45.652 07:14:48 -- common/autotest_common.sh@1177 -- # local i=0 00:16:45.652 07:14:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:45.652 07:14:48 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:16:45.652 07:14:48 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:16:45.652 07:14:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:47.549 07:14:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:47.549 07:14:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:47.549 07:14:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:47.549 07:14:50 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:16:47.549 07:14:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:47.549 07:14:50 -- common/autotest_common.sh@1187 -- # return 0 00:16:47.549 07:14:50 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:47.549 [global] 00:16:47.549 thread=1 00:16:47.549 invalidate=1 00:16:47.549 rw=write 00:16:47.549 time_based=1 00:16:47.549 runtime=1 00:16:47.549 ioengine=libaio 00:16:47.549 direct=1 00:16:47.549 bs=4096 00:16:47.549 iodepth=1 00:16:47.549 norandommap=0 00:16:47.549 numjobs=1 00:16:47.549 00:16:47.549 verify_dump=1 00:16:47.549 verify_backlog=512 00:16:47.549 verify_state_save=0 00:16:47.549 do_verify=1 00:16:47.549 verify=crc32c-intel 00:16:47.549 [job0] 00:16:47.549 filename=/dev/nvme0n1 00:16:47.549 [job1] 00:16:47.549 filename=/dev/nvme0n2 00:16:47.549 [job2] 00:16:47.549 filename=/dev/nvme0n3 00:16:47.549 [job3] 00:16:47.549 filename=/dev/nvme0n4 00:16:47.549 Could not set queue depth (nvme0n1) 00:16:47.549 Could not set queue depth (nvme0n2) 00:16:47.549 Could not set queue depth (nvme0n3) 00:16:47.549 Could not set queue depth (nvme0n4) 00:16:47.807 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:47.807 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:47.807 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:47.807 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:47.807 fio-3.35 00:16:47.807 Starting 4 threads 00:16:49.180 00:16:49.180 job0: (groupid=0, jobs=1): err= 0: pid=1908843: Wed Oct 16 07:14:51 2024 00:16:49.180 read: IOPS=21, BW=86.4KiB/s (88.4kB/s)(88.0KiB/1019msec) 00:16:49.180 slat (nsec): min=14717, max=34612, avg=18501.05, stdev=6342.39 00:16:49.180 clat (usec): min=40928, max=41994, avg=41451.62, stdev=506.63 00:16:49.180 lat (usec): min=40955, max=42027, avg=41470.12, stdev=505.55 00:16:49.180 clat percentiles (usec): 00:16:49.180 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:49.180 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[42206], 00:16:49.180 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:49.180 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:49.180 | 99.99th=[42206] 00:16:49.180 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:16:49.180 slat (nsec): min=7488, max=92808, avg=14327.60, stdev=8031.36 00:16:49.180 clat (usec): min=153, max=298, avg=188.97, stdev=18.83 00:16:49.180 lat (usec): min=162, max=306, avg=203.29, stdev=22.93 00:16:49.180 clat percentiles (usec): 00:16:49.180 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 172], 00:16:49.180 | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 192], 00:16:49.180 | 70.00th=[ 198], 80.00th=[ 206], 90.00th=[ 215], 95.00th=[ 221], 00:16:49.180 | 99.00th=[ 235], 99.50th=[ 245], 99.90th=[ 297], 99.95th=[ 297], 00:16:49.180 | 99.99th=[ 297] 00:16:49.180 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:49.180 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:49.180 lat (usec) : 250=95.51%, 500=0.37% 00:16:49.180 lat (msec) : 50=4.12% 00:16:49.180 cpu : usr=0.39%, sys=0.98%, ctx=534, majf=0, minf=1 00:16:49.180 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.180 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.181 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.181 job1: (groupid=0, jobs=1): err= 0: pid=1908844: Wed Oct 16 07:14:51 2024 00:16:49.181 read: IOPS=260, BW=1042KiB/s (1067kB/s)(1060KiB/1017msec) 00:16:49.181 slat (nsec): min=7049, max=37445, avg=12969.15, stdev=5808.25 00:16:49.181 clat (usec): min=208, max=42002, avg=3344.41, stdev=10831.04 00:16:49.181 lat (usec): min=216, max=42018, avg=3357.38, stdev=10831.75 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[ 215], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 231], 00:16:49.181 | 30.00th=[ 235], 40.00th=[ 243], 50.00th=[ 253], 60.00th=[ 260], 00:16:49.181 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 347], 95.00th=[40633], 00:16:49.181 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:49.181 | 99.99th=[42206] 00:16:49.181 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:16:49.181 slat (nsec): min=7841, max=42645, avg=16216.31, stdev=7065.99 00:16:49.181 clat (usec): min=169, max=394, avg=224.83, stdev=25.93 00:16:49.181 lat (usec): min=189, max=416, avg=241.05, stdev=23.06 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 190], 20.00th=[ 202], 00:16:49.181 | 30.00th=[ 212], 40.00th=[ 221], 50.00th=[ 225], 60.00th=[ 233], 00:16:49.181 | 70.00th=[ 239], 80.00th=[ 245], 90.00th=[ 253], 95.00th=[ 262], 00:16:49.181 | 99.00th=[ 293], 99.50th=[ 306], 99.90th=[ 396], 99.95th=[ 396], 00:16:49.181 | 99.99th=[ 396] 00:16:49.181 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:49.181 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:49.181 lat (usec) : 250=73.75%, 500=23.42%, 750=0.13%, 1000=0.13% 00:16:49.181 lat (msec) : 50=2.57% 00:16:49.181 cpu : usr=0.59%, sys=1.67%, ctx=778, majf=0, minf=1 00:16:49.181 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 issued rwts: total=265,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.181 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.181 job2: (groupid=0, jobs=1): err= 0: pid=1908847: Wed Oct 16 07:14:51 2024 00:16:49.181 read: IOPS=134, BW=538KiB/s (551kB/s)(548KiB/1018msec) 00:16:49.181 slat (nsec): min=8796, max=33876, avg=10908.66, stdev=3866.73 00:16:49.181 clat (usec): min=196, max=42217, avg=6501.83, stdev=14760.96 00:16:49.181 lat (usec): min=205, max=42228, avg=6512.74, stdev=14763.75 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[ 200], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 212], 00:16:49.181 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 269], 60.00th=[ 277], 00:16:49.181 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[41157], 95.00th=[41157], 00:16:49.181 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:49.181 | 99.99th=[42206] 00:16:49.181 write: IOPS=502, BW=2012KiB/s (2060kB/s)(2048KiB/1018msec); 0 zone resets 00:16:49.181 slat (nsec): min=6461, max=41294, avg=13447.55, stdev=6878.36 00:16:49.181 clat (usec): min=157, max=431, avg=228.12, stdev=26.02 00:16:49.181 lat (usec): min=184, max=455, avg=241.57, stdev=25.18 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[ 176], 5.00th=[ 188], 10.00th=[ 198], 20.00th=[ 210], 00:16:49.181 | 30.00th=[ 217], 40.00th=[ 223], 50.00th=[ 229], 60.00th=[ 235], 00:16:49.181 | 70.00th=[ 239], 80.00th=[ 245], 90.00th=[ 255], 95.00th=[ 265], 00:16:49.181 | 99.00th=[ 285], 99.50th=[ 359], 99.90th=[ 433], 99.95th=[ 433], 00:16:49.181 | 99.99th=[ 433] 00:16:49.181 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:49.181 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:49.181 lat (usec) : 250=78.58%, 500=18.18% 00:16:49.181 lat (msec) : 50=3.24% 00:16:49.181 cpu : usr=1.08%, sys=0.20%, ctx=652, majf=0, minf=1 00:16:49.181 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 issued rwts: total=137,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.181 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.181 job3: (groupid=0, jobs=1): err= 0: pid=1908848: Wed Oct 16 07:14:51 2024 00:16:49.181 read: IOPS=21, BW=85.8KiB/s (87.8kB/s)(88.0KiB/1026msec) 00:16:49.181 slat (nsec): min=15031, max=34759, avg=18283.50, stdev=5670.29 00:16:49.181 clat (usec): min=40906, max=42027, avg=41337.72, stdev=469.54 00:16:49.181 lat (usec): min=40940, max=42045, avg=41356.00, stdev=467.86 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:49.181 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:49.181 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:49.181 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:49.181 | 99.99th=[42206] 00:16:49.181 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:16:49.181 slat (nsec): min=7855, max=36115, avg=14951.08, stdev=6964.48 00:16:49.181 clat (usec): min=152, max=325, avg=206.83, stdev=20.18 00:16:49.181 lat (usec): min=161, max=347, avg=221.78, stdev=23.81 00:16:49.181 clat percentiles (usec): 00:16:49.181 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 190], 00:16:49.181 | 30.00th=[ 196], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 210], 00:16:49.181 | 70.00th=[ 217], 80.00th=[ 223], 90.00th=[ 233], 95.00th=[ 239], 00:16:49.181 | 99.00th=[ 260], 99.50th=[ 269], 99.90th=[ 326], 99.95th=[ 326], 00:16:49.181 | 99.99th=[ 326] 00:16:49.181 bw ( KiB/s): min= 4096, max= 4096, per=51.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:49.181 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:49.181 lat (usec) : 250=93.63%, 500=2.25% 00:16:49.181 lat (msec) : 50=4.12% 00:16:49.181 cpu : usr=0.68%, sys=0.78%, ctx=535, majf=0, minf=1 00:16:49.181 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:49.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:49.181 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:49.181 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:49.181 00:16:49.181 Run status group 0 (all jobs): 00:16:49.181 READ: bw=1739KiB/s (1781kB/s), 85.8KiB/s-1042KiB/s (87.8kB/s-1067kB/s), io=1784KiB (1827kB), run=1017-1026msec 00:16:49.181 WRITE: bw=7984KiB/s (8176kB/s), 1996KiB/s-2014KiB/s (2044kB/s-2062kB/s), io=8192KiB (8389kB), run=1017-1026msec 00:16:49.181 00:16:49.181 Disk stats (read/write): 00:16:49.181 nvme0n1: ios=67/512, merge=0/0, ticks=720/85, in_queue=805, util=86.57% 00:16:49.181 nvme0n2: ios=309/512, merge=0/0, ticks=1601/106, in_queue=1707, util=98.27% 00:16:49.181 nvme0n3: ios=42/512, merge=0/0, ticks=1691/113, in_queue=1804, util=98.22% 00:16:49.181 nvme0n4: ios=43/512, merge=0/0, ticks=1656/106, in_queue=1762, util=98.31% 00:16:49.181 07:14:51 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:49.181 [global] 00:16:49.181 thread=1 00:16:49.181 invalidate=1 00:16:49.181 rw=randwrite 00:16:49.181 time_based=1 00:16:49.181 runtime=1 00:16:49.181 ioengine=libaio 00:16:49.181 direct=1 00:16:49.181 bs=4096 00:16:49.181 iodepth=1 00:16:49.181 norandommap=0 00:16:49.181 numjobs=1 00:16:49.181 00:16:49.181 verify_dump=1 00:16:49.181 verify_backlog=512 00:16:49.181 verify_state_save=0 00:16:49.181 do_verify=1 00:16:49.181 verify=crc32c-intel 00:16:49.181 [job0] 00:16:49.181 filename=/dev/nvme0n1 00:16:49.181 [job1] 00:16:49.181 filename=/dev/nvme0n2 00:16:49.181 [job2] 00:16:49.181 filename=/dev/nvme0n3 00:16:49.181 [job3] 00:16:49.181 filename=/dev/nvme0n4 00:16:49.181 Could not set queue depth (nvme0n1) 00:16:49.181 Could not set queue depth (nvme0n2) 00:16:49.181 Could not set queue depth (nvme0n3) 00:16:49.181 Could not set queue depth (nvme0n4) 00:16:49.181 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.181 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.181 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.181 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:49.181 fio-3.35 00:16:49.181 Starting 4 threads 00:16:50.554 00:16:50.554 job0: (groupid=0, jobs=1): err= 0: pid=1909087: Wed Oct 16 07:14:53 2024 00:16:50.554 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:50.554 slat (nsec): min=5645, max=52983, avg=10925.56, stdev=6206.05 00:16:50.554 clat (usec): min=173, max=41113, avg=260.07, stdev=905.31 00:16:50.554 lat (usec): min=179, max=41144, avg=270.99, stdev=905.93 00:16:50.554 clat percentiles (usec): 00:16:50.554 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 194], 00:16:50.554 | 30.00th=[ 202], 40.00th=[ 212], 50.00th=[ 229], 60.00th=[ 251], 00:16:50.554 | 70.00th=[ 269], 80.00th=[ 281], 90.00th=[ 297], 95.00th=[ 314], 00:16:50.554 | 99.00th=[ 355], 99.50th=[ 494], 99.90th=[ 914], 99.95th=[ 1434], 00:16:50.554 | 99.99th=[41157] 00:16:50.554 write: IOPS=2210, BW=8843KiB/s (9055kB/s)(8852KiB/1001msec); 0 zone resets 00:16:50.554 slat (nsec): min=7245, max=57577, avg=13550.30, stdev=7587.04 00:16:50.554 clat (usec): min=126, max=1641, avg=180.92, stdev=51.26 00:16:50.554 lat (usec): min=133, max=1652, avg=194.47, stdev=55.42 00:16:50.554 clat percentiles (usec): 00:16:50.554 | 1.00th=[ 131], 5.00th=[ 135], 10.00th=[ 139], 20.00th=[ 147], 00:16:50.554 | 30.00th=[ 155], 40.00th=[ 161], 50.00th=[ 167], 60.00th=[ 176], 00:16:50.554 | 70.00th=[ 190], 80.00th=[ 219], 90.00th=[ 243], 95.00th=[ 265], 00:16:50.554 | 99.00th=[ 297], 99.50th=[ 306], 99.90th=[ 347], 99.95th=[ 392], 00:16:50.554 | 99.99th=[ 1647] 00:16:50.554 bw ( KiB/s): min= 8192, max= 8192, per=39.49%, avg=8192.00, stdev= 0.00, samples=1 00:16:50.554 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:50.554 lat (usec) : 250=76.09%, 500=23.66%, 750=0.05%, 1000=0.14% 00:16:50.554 lat (msec) : 2=0.05%, 50=0.02% 00:16:50.554 cpu : usr=3.20%, sys=7.60%, ctx=4263, majf=0, minf=1 00:16:50.554 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.554 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.554 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.554 issued rwts: total=2048,2213,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.554 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.554 job1: (groupid=0, jobs=1): err= 0: pid=1909088: Wed Oct 16 07:14:53 2024 00:16:50.554 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4100KiB/1002msec) 00:16:50.554 slat (nsec): min=4830, max=72705, avg=12739.95, stdev=6586.74 00:16:50.554 clat (usec): min=188, max=41220, avg=685.69, stdev=4197.76 00:16:50.554 lat (usec): min=193, max=41227, avg=698.43, stdev=4197.88 00:16:50.554 clat percentiles (usec): 00:16:50.554 | 1.00th=[ 198], 5.00th=[ 208], 10.00th=[ 212], 20.00th=[ 217], 00:16:50.554 | 30.00th=[ 223], 40.00th=[ 227], 50.00th=[ 233], 60.00th=[ 241], 00:16:50.554 | 70.00th=[ 247], 80.00th=[ 273], 90.00th=[ 314], 95.00th=[ 367], 00:16:50.554 | 99.00th=[40633], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:50.554 | 99.99th=[41157] 00:16:50.554 write: IOPS=1532, BW=6132KiB/s (6279kB/s)(6144KiB/1002msec); 0 zone resets 00:16:50.554 slat (nsec): min=6431, max=42005, avg=13929.17, stdev=5431.43 00:16:50.554 clat (usec): min=130, max=389, avg=165.84, stdev=25.88 00:16:50.554 lat (usec): min=138, max=425, avg=179.77, stdev=27.97 00:16:50.554 clat percentiles (usec): 00:16:50.554 | 1.00th=[ 135], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 149], 00:16:50.554 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 165], 00:16:50.554 | 70.00th=[ 169], 80.00th=[ 176], 90.00th=[ 190], 95.00th=[ 210], 00:16:50.554 | 99.00th=[ 273], 99.50th=[ 281], 99.90th=[ 388], 99.95th=[ 392], 00:16:50.554 | 99.99th=[ 392] 00:16:50.555 bw ( KiB/s): min= 8192, max= 8192, per=39.49%, avg=8192.00, stdev= 0.00, samples=1 00:16:50.555 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:50.555 lat (usec) : 250=87.00%, 500=12.38%, 750=0.16%, 1000=0.04% 00:16:50.555 lat (msec) : 50=0.43% 00:16:50.555 cpu : usr=1.90%, sys=3.40%, ctx=2564, majf=0, minf=1 00:16:50.555 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.555 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 issued rwts: total=1025,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.555 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.555 job2: (groupid=0, jobs=1): err= 0: pid=1909089: Wed Oct 16 07:14:53 2024 00:16:50.555 read: IOPS=516, BW=2065KiB/s (2114kB/s)(2104KiB/1019msec) 00:16:50.555 slat (nsec): min=4397, max=54674, avg=19069.21, stdev=13200.56 00:16:50.555 clat (usec): min=212, max=41957, avg=1453.04, stdev=6556.05 00:16:50.555 lat (usec): min=217, max=41991, avg=1472.11, stdev=6556.12 00:16:50.555 clat percentiles (usec): 00:16:50.555 | 1.00th=[ 223], 5.00th=[ 233], 10.00th=[ 237], 20.00th=[ 245], 00:16:50.555 | 30.00th=[ 255], 40.00th=[ 289], 50.00th=[ 437], 60.00th=[ 461], 00:16:50.555 | 70.00th=[ 474], 80.00th=[ 478], 90.00th=[ 486], 95.00th=[ 494], 00:16:50.555 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:50.555 | 99.99th=[42206] 00:16:50.555 write: IOPS=1004, BW=4020KiB/s (4116kB/s)(4096KiB/1019msec); 0 zone resets 00:16:50.555 slat (nsec): min=6070, max=48323, avg=13348.13, stdev=6852.35 00:16:50.555 clat (usec): min=138, max=473, avg=218.73, stdev=56.51 00:16:50.555 lat (usec): min=144, max=502, avg=232.08, stdev=57.85 00:16:50.555 clat percentiles (usec): 00:16:50.555 | 1.00th=[ 147], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 174], 00:16:50.555 | 30.00th=[ 188], 40.00th=[ 198], 50.00th=[ 208], 60.00th=[ 217], 00:16:50.555 | 70.00th=[ 227], 80.00th=[ 255], 90.00th=[ 297], 95.00th=[ 351], 00:16:50.555 | 99.00th=[ 388], 99.50th=[ 404], 99.90th=[ 445], 99.95th=[ 474], 00:16:50.555 | 99.99th=[ 474] 00:16:50.555 bw ( KiB/s): min= 8192, max= 8192, per=39.49%, avg=8192.00, stdev= 0.00, samples=1 00:16:50.555 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:50.555 lat (usec) : 250=60.90%, 500=37.74%, 750=0.45% 00:16:50.555 lat (msec) : 50=0.90% 00:16:50.555 cpu : usr=1.08%, sys=2.46%, ctx=1551, majf=0, minf=1 00:16:50.555 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.555 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 issued rwts: total=526,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.555 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.555 job3: (groupid=0, jobs=1): err= 0: pid=1909090: Wed Oct 16 07:14:53 2024 00:16:50.555 read: IOPS=34, BW=137KiB/s (141kB/s)(140KiB/1019msec) 00:16:50.555 slat (nsec): min=5506, max=36352, avg=15019.66, stdev=9367.08 00:16:50.555 clat (usec): min=240, max=42004, avg=25440.28, stdev=19634.09 00:16:50.555 lat (usec): min=248, max=42040, avg=25455.30, stdev=19639.42 00:16:50.555 clat percentiles (usec): 00:16:50.555 | 1.00th=[ 241], 5.00th=[ 265], 10.00th=[ 285], 20.00th=[ 297], 00:16:50.555 | 30.00th=[ 474], 40.00th=[12125], 50.00th=[41157], 60.00th=[41157], 00:16:50.555 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:16:50.555 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:50.555 | 99.99th=[42206] 00:16:50.555 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:16:50.555 slat (nsec): min=7781, max=58584, avg=18930.14, stdev=6724.37 00:16:50.555 clat (usec): min=151, max=492, avg=225.03, stdev=39.49 00:16:50.555 lat (usec): min=168, max=524, avg=243.96, stdev=40.78 00:16:50.555 clat percentiles (usec): 00:16:50.555 | 1.00th=[ 176], 5.00th=[ 186], 10.00th=[ 192], 20.00th=[ 200], 00:16:50.555 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 221], 00:16:50.555 | 70.00th=[ 227], 80.00th=[ 239], 90.00th=[ 269], 95.00th=[ 314], 00:16:50.555 | 99.00th=[ 379], 99.50th=[ 388], 99.90th=[ 494], 99.95th=[ 494], 00:16:50.555 | 99.99th=[ 494] 00:16:50.555 bw ( KiB/s): min= 4096, max= 4096, per=19.74%, avg=4096.00, stdev= 0.00, samples=1 00:16:50.555 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:50.555 lat (usec) : 250=80.62%, 500=14.99%, 750=0.18% 00:16:50.555 lat (msec) : 20=0.37%, 50=3.84% 00:16:50.555 cpu : usr=0.59%, sys=0.79%, ctx=549, majf=0, minf=2 00:16:50.555 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:50.555 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.555 issued rwts: total=35,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.555 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:50.555 00:16:50.555 Run status group 0 (all jobs): 00:16:50.555 READ: bw=13.9MiB/s (14.6MB/s), 137KiB/s-8184KiB/s (141kB/s-8380kB/s), io=14.2MiB (14.9MB), run=1001-1019msec 00:16:50.555 WRITE: bw=20.3MiB/s (21.2MB/s), 2010KiB/s-8843KiB/s (2058kB/s-9055kB/s), io=20.6MiB (21.6MB), run=1001-1019msec 00:16:50.555 00:16:50.555 Disk stats (read/write): 00:16:50.555 nvme0n1: ios=1697/2048, merge=0/0, ticks=799/349, in_queue=1148, util=96.39% 00:16:50.555 nvme0n2: ios=1055/1024, merge=0/0, ticks=1488/157, in_queue=1645, util=96.35% 00:16:50.555 nvme0n3: ios=566/1024, merge=0/0, ticks=1396/217, in_queue=1613, util=97.19% 00:16:50.555 nvme0n4: ios=55/512, merge=0/0, ticks=1673/110, in_queue=1783, util=97.28% 00:16:50.555 07:14:53 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:50.555 [global] 00:16:50.555 thread=1 00:16:50.555 invalidate=1 00:16:50.555 rw=write 00:16:50.555 time_based=1 00:16:50.555 runtime=1 00:16:50.555 ioengine=libaio 00:16:50.555 direct=1 00:16:50.555 bs=4096 00:16:50.555 iodepth=128 00:16:50.555 norandommap=0 00:16:50.555 numjobs=1 00:16:50.555 00:16:50.555 verify_dump=1 00:16:50.555 verify_backlog=512 00:16:50.555 verify_state_save=0 00:16:50.555 do_verify=1 00:16:50.555 verify=crc32c-intel 00:16:50.555 [job0] 00:16:50.555 filename=/dev/nvme0n1 00:16:50.555 [job1] 00:16:50.555 filename=/dev/nvme0n2 00:16:50.555 [job2] 00:16:50.555 filename=/dev/nvme0n3 00:16:50.555 [job3] 00:16:50.555 filename=/dev/nvme0n4 00:16:50.555 Could not set queue depth (nvme0n1) 00:16:50.555 Could not set queue depth (nvme0n2) 00:16:50.555 Could not set queue depth (nvme0n3) 00:16:50.555 Could not set queue depth (nvme0n4) 00:16:50.555 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.555 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.555 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.555 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:50.555 fio-3.35 00:16:50.555 Starting 4 threads 00:16:51.929 00:16:51.929 job0: (groupid=0, jobs=1): err= 0: pid=1909332: Wed Oct 16 07:14:54 2024 00:16:51.929 read: IOPS=3045, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec) 00:16:51.929 slat (usec): min=2, max=27982, avg=154.62, stdev=1310.34 00:16:51.929 clat (usec): min=675, max=71725, avg=20137.79, stdev=13322.06 00:16:51.929 lat (usec): min=4779, max=71760, avg=20292.41, stdev=13423.58 00:16:51.929 clat percentiles (usec): 00:16:51.929 | 1.00th=[ 6849], 5.00th=[ 8848], 10.00th=[10028], 20.00th=[10814], 00:16:51.929 | 30.00th=[11994], 40.00th=[12911], 50.00th=[13829], 60.00th=[14877], 00:16:51.929 | 70.00th=[20841], 80.00th=[31065], 90.00th=[38536], 95.00th=[45876], 00:16:51.929 | 99.00th=[60031], 99.50th=[66323], 99.90th=[66323], 99.95th=[66323], 00:16:51.929 | 99.99th=[71828] 00:16:51.929 write: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec); 0 zone resets 00:16:51.929 slat (usec): min=3, max=20735, avg=163.41, stdev=1046.99 00:16:51.929 clat (usec): min=974, max=119106, avg=21460.49, stdev=19905.88 00:16:51.929 lat (usec): min=1017, max=119112, avg=21623.89, stdev=20025.15 00:16:51.929 clat percentiles (msec): 00:16:51.929 | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], 00:16:51.929 | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 19], 60.00th=[ 21], 00:16:51.929 | 70.00th=[ 23], 80.00th=[ 27], 90.00th=[ 35], 95.00th=[ 58], 00:16:51.929 | 99.00th=[ 117], 99.50th=[ 118], 99.90th=[ 120], 99.95th=[ 120], 00:16:51.929 | 99.99th=[ 120] 00:16:51.929 bw ( KiB/s): min= 8160, max=16416, per=19.84%, avg=12288.00, stdev=5837.87, samples=2 00:16:51.929 iops : min= 2040, max= 4104, avg=3072.00, stdev=1459.47, samples=2 00:16:51.929 lat (usec) : 750=0.02%, 1000=0.02% 00:16:51.929 lat (msec) : 2=0.26%, 4=1.17%, 10=13.41%, 20=50.13%, 50=29.71% 00:16:51.929 lat (msec) : 100=3.99%, 250=1.29% 00:16:51.929 cpu : usr=1.69%, sys=3.68%, ctx=319, majf=0, minf=1 00:16:51.929 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:51.929 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.929 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:51.929 issued rwts: total=3064,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:51.929 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:51.929 job1: (groupid=0, jobs=1): err= 0: pid=1909333: Wed Oct 16 07:14:54 2024 00:16:51.929 read: IOPS=3524, BW=13.8MiB/s (14.4MB/s)(14.0MiB/1017msec) 00:16:51.929 slat (usec): min=2, max=33803, avg=147.80, stdev=1373.41 00:16:51.929 clat (usec): min=2537, max=94775, avg=19413.68, stdev=16953.88 00:16:51.929 lat (msec): min=2, max=105, avg=19.56, stdev=17.07 00:16:51.929 clat percentiles (usec): 00:16:51.929 | 1.00th=[ 6521], 5.00th=[ 7701], 10.00th=[ 8979], 20.00th=[ 9634], 00:16:51.929 | 30.00th=[10028], 40.00th=[10683], 50.00th=[13042], 60.00th=[16909], 00:16:51.929 | 70.00th=[19530], 80.00th=[21365], 90.00th=[38011], 95.00th=[69731], 00:16:51.929 | 99.00th=[85459], 99.50th=[94897], 99.90th=[94897], 99.95th=[94897], 00:16:51.929 | 99.99th=[94897] 00:16:51.929 write: IOPS=3954, BW=15.4MiB/s (16.2MB/s)(15.7MiB/1017msec); 0 zone resets 00:16:51.929 slat (usec): min=3, max=25514, avg=90.43, stdev=728.42 00:16:51.929 clat (usec): min=434, max=65766, avg=13837.05, stdev=9194.55 00:16:51.929 lat (usec): min=444, max=65772, avg=13927.48, stdev=9255.93 00:16:51.929 clat percentiles (usec): 00:16:51.929 | 1.00th=[ 1483], 5.00th=[ 4015], 10.00th=[ 5604], 20.00th=[ 7701], 00:16:51.929 | 30.00th=[ 9241], 40.00th=[10552], 50.00th=[11338], 60.00th=[13829], 00:16:51.929 | 70.00th=[15795], 80.00th=[18220], 90.00th=[21103], 95.00th=[30278], 00:16:51.929 | 99.00th=[58983], 99.50th=[65799], 99.90th=[65799], 99.95th=[65799], 00:16:51.929 | 99.99th=[65799] 00:16:51.929 bw ( KiB/s): min=12288, max=18872, per=25.15%, avg=15580.00, stdev=4655.59, samples=2 00:16:51.929 iops : min= 3072, max= 4718, avg=3895.00, stdev=1163.90, samples=2 00:16:51.929 lat (usec) : 500=0.03%, 1000=0.13% 00:16:51.929 lat (msec) : 2=0.60%, 4=2.00%, 10=28.86%, 20=50.75%, 50=13.29% 00:16:51.929 lat (msec) : 100=4.34% 00:16:51.929 cpu : usr=3.64%, sys=5.02%, ctx=347, majf=0, minf=2 00:16:51.929 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:51.929 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.929 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:51.929 issued rwts: total=3584,4022,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:51.929 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:51.929 job2: (groupid=0, jobs=1): err= 0: pid=1909334: Wed Oct 16 07:14:54 2024 00:16:51.929 read: IOPS=4535, BW=17.7MiB/s (18.6MB/s)(18.0MiB/1016msec) 00:16:51.929 slat (usec): min=3, max=16529, avg=101.06, stdev=759.59 00:16:51.929 clat (usec): min=4245, max=36562, avg=12964.75, stdev=4229.60 00:16:51.929 lat (usec): min=4253, max=36576, avg=13065.81, stdev=4282.97 00:16:51.929 clat percentiles (usec): 00:16:51.929 | 1.00th=[ 5014], 5.00th=[ 8160], 10.00th=[ 8979], 20.00th=[ 9634], 00:16:51.929 | 30.00th=[10421], 40.00th=[10945], 50.00th=[11207], 60.00th=[12780], 00:16:51.929 | 70.00th=[14746], 80.00th=[16909], 90.00th=[18220], 95.00th=[20055], 00:16:51.929 | 99.00th=[26608], 99.50th=[27657], 99.90th=[32375], 99.95th=[32375], 00:16:51.929 | 99.99th=[36439] 00:16:51.929 write: IOPS=4990, BW=19.5MiB/s (20.4MB/s)(19.8MiB/1016msec); 0 zone resets 00:16:51.929 slat (usec): min=4, max=11489, avg=95.90, stdev=606.31 00:16:51.929 clat (usec): min=2337, max=36324, avg=13626.98, stdev=5635.42 00:16:51.929 lat (usec): min=2355, max=36336, avg=13722.88, stdev=5686.15 00:16:51.929 clat percentiles (usec): 00:16:51.929 | 1.00th=[ 4424], 5.00th=[ 6194], 10.00th=[ 7898], 20.00th=[ 9765], 00:16:51.930 | 30.00th=[10683], 40.00th=[11338], 50.00th=[12125], 60.00th=[12911], 00:16:51.930 | 70.00th=[13960], 80.00th=[18220], 90.00th=[21103], 95.00th=[25035], 00:16:51.930 | 99.00th=[31851], 99.50th=[32900], 99.90th=[36439], 99.95th=[36439], 00:16:51.930 | 99.99th=[36439] 00:16:51.930 bw ( KiB/s): min=19064, max=20480, per=31.92%, avg=19772.00, stdev=1001.26, samples=2 00:16:51.930 iops : min= 4766, max= 5120, avg=4943.00, stdev=250.32, samples=2 00:16:51.930 lat (msec) : 4=0.30%, 10=22.41%, 20=67.53%, 50=9.75% 00:16:51.930 cpu : usr=5.52%, sys=8.18%, ctx=419, majf=0, minf=2 00:16:51.930 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:51.930 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.930 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:51.930 issued rwts: total=4608,5070,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:51.930 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:51.930 job3: (groupid=0, jobs=1): err= 0: pid=1909335: Wed Oct 16 07:14:54 2024 00:16:51.930 read: IOPS=3480, BW=13.6MiB/s (14.3MB/s)(13.7MiB/1006msec) 00:16:51.930 slat (usec): min=3, max=23044, avg=138.60, stdev=982.53 00:16:51.930 clat (usec): min=3635, max=65447, avg=16930.29, stdev=8645.76 00:16:51.930 lat (usec): min=6043, max=65455, avg=17068.90, stdev=8722.55 00:16:51.930 clat percentiles (usec): 00:16:51.930 | 1.00th=[ 7373], 5.00th=[10290], 10.00th=[10683], 20.00th=[11338], 00:16:51.930 | 30.00th=[12911], 40.00th=[13698], 50.00th=[14746], 60.00th=[15533], 00:16:51.930 | 70.00th=[17433], 80.00th=[19530], 90.00th=[24511], 95.00th=[34341], 00:16:51.930 | 99.00th=[57934], 99.50th=[61080], 99.90th=[65274], 99.95th=[65274], 00:16:51.930 | 99.99th=[65274] 00:16:51.930 write: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec); 0 zone resets 00:16:51.930 slat (usec): min=4, max=10539, avg=134.71, stdev=690.11 00:16:51.930 clat (usec): min=2998, max=65452, avg=19061.64, stdev=11472.23 00:16:51.930 lat (usec): min=3008, max=65461, avg=19196.35, stdev=11557.42 00:16:51.930 clat percentiles (usec): 00:16:51.930 | 1.00th=[ 5932], 5.00th=[ 9634], 10.00th=[ 9765], 20.00th=[10814], 00:16:51.930 | 30.00th=[11863], 40.00th=[12518], 50.00th=[15008], 60.00th=[15926], 00:16:51.930 | 70.00th=[19792], 80.00th=[27395], 90.00th=[37487], 95.00th=[44827], 00:16:51.930 | 99.00th=[54264], 99.50th=[54789], 99.90th=[54789], 99.95th=[65274], 00:16:51.930 | 99.99th=[65274] 00:16:51.930 bw ( KiB/s): min=12560, max=16112, per=23.15%, avg=14336.00, stdev=2511.64, samples=2 00:16:51.930 iops : min= 3140, max= 4028, avg=3584.00, stdev=627.91, samples=2 00:16:51.930 lat (msec) : 4=0.18%, 10=8.74%, 20=69.77%, 50=18.96%, 100=2.36% 00:16:51.930 cpu : usr=5.17%, sys=6.17%, ctx=335, majf=0, minf=2 00:16:51.930 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:51.930 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:51.930 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:51.930 issued rwts: total=3501,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:51.930 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:51.930 00:16:51.930 Run status group 0 (all jobs): 00:16:51.930 READ: bw=56.7MiB/s (59.4MB/s), 11.9MiB/s-17.7MiB/s (12.5MB/s-18.6MB/s), io=57.6MiB (60.4MB), run=1006-1017msec 00:16:51.930 WRITE: bw=60.5MiB/s (63.4MB/s), 11.9MiB/s-19.5MiB/s (12.5MB/s-20.4MB/s), io=61.5MiB (64.5MB), run=1006-1017msec 00:16:51.930 00:16:51.930 Disk stats (read/write): 00:16:51.930 nvme0n1: ios=2600/3023, merge=0/0, ticks=22014/35127, in_queue=57141, util=95.89% 00:16:51.930 nvme0n2: ios=3122/3383, merge=0/0, ticks=36372/27513, in_queue=63885, util=98.38% 00:16:51.930 nvme0n3: ios=4137/4431, merge=0/0, ticks=48336/54808, in_queue=103144, util=97.19% 00:16:51.930 nvme0n4: ios=2618/3015, merge=0/0, ticks=45014/60202, in_queue=105216, util=98.32% 00:16:51.930 07:14:54 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:51.930 [global] 00:16:51.930 thread=1 00:16:51.930 invalidate=1 00:16:51.930 rw=randwrite 00:16:51.930 time_based=1 00:16:51.930 runtime=1 00:16:51.930 ioengine=libaio 00:16:51.930 direct=1 00:16:51.930 bs=4096 00:16:51.930 iodepth=128 00:16:51.930 norandommap=0 00:16:51.930 numjobs=1 00:16:51.930 00:16:51.930 verify_dump=1 00:16:51.930 verify_backlog=512 00:16:51.930 verify_state_save=0 00:16:51.930 do_verify=1 00:16:51.930 verify=crc32c-intel 00:16:51.930 [job0] 00:16:51.930 filename=/dev/nvme0n1 00:16:51.930 [job1] 00:16:51.930 filename=/dev/nvme0n2 00:16:51.930 [job2] 00:16:51.930 filename=/dev/nvme0n3 00:16:51.930 [job3] 00:16:51.930 filename=/dev/nvme0n4 00:16:51.930 Could not set queue depth (nvme0n1) 00:16:51.930 Could not set queue depth (nvme0n2) 00:16:51.930 Could not set queue depth (nvme0n3) 00:16:51.930 Could not set queue depth (nvme0n4) 00:16:52.188 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.188 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.188 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.188 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:52.188 fio-3.35 00:16:52.188 Starting 4 threads 00:16:53.562 00:16:53.562 job0: (groupid=0, jobs=1): err= 0: pid=1909596: Wed Oct 16 07:14:56 2024 00:16:53.562 read: IOPS=5074, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1009msec) 00:16:53.562 slat (usec): min=2, max=10664, avg=92.82, stdev=607.55 00:16:53.562 clat (usec): min=3131, max=29567, avg=11799.91, stdev=3479.90 00:16:53.562 lat (usec): min=3137, max=29582, avg=11892.73, stdev=3523.13 00:16:53.562 clat percentiles (usec): 00:16:53.562 | 1.00th=[ 6063], 5.00th=[ 7504], 10.00th=[ 8160], 20.00th=[ 9503], 00:16:53.562 | 30.00th=[ 9765], 40.00th=[10421], 50.00th=[10945], 60.00th=[11731], 00:16:53.562 | 70.00th=[12518], 80.00th=[14353], 90.00th=[16909], 95.00th=[17695], 00:16:53.562 | 99.00th=[23200], 99.50th=[27132], 99.90th=[28967], 99.95th=[29492], 00:16:53.562 | 99.99th=[29492] 00:16:53.562 write: IOPS=5465, BW=21.4MiB/s (22.4MB/s)(21.5MiB/1009msec); 0 zone resets 00:16:53.562 slat (usec): min=3, max=9853, avg=79.75, stdev=415.96 00:16:53.562 clat (usec): min=1677, max=43221, avg=12256.19, stdev=5990.72 00:16:53.562 lat (usec): min=1701, max=43239, avg=12335.94, stdev=6033.60 00:16:53.562 clat percentiles (usec): 00:16:53.562 | 1.00th=[ 2966], 5.00th=[ 5538], 10.00th=[ 6521], 20.00th=[ 9896], 00:16:53.562 | 30.00th=[10421], 40.00th=[10814], 50.00th=[10945], 60.00th=[11076], 00:16:53.562 | 70.00th=[11338], 80.00th=[12518], 90.00th=[20317], 95.00th=[27132], 00:16:53.562 | 99.00th=[34341], 99.50th=[35390], 99.90th=[35914], 99.95th=[35914], 00:16:53.562 | 99.99th=[43254] 00:16:53.562 bw ( KiB/s): min=20976, max=22128, per=31.10%, avg=21552.00, stdev=814.59, samples=2 00:16:53.562 iops : min= 5244, max= 5532, avg=5388.00, stdev=203.65, samples=2 00:16:53.562 lat (msec) : 2=0.27%, 4=1.16%, 10=27.47%, 20=64.92%, 50=6.19% 00:16:53.562 cpu : usr=5.06%, sys=7.94%, ctx=612, majf=0, minf=1 00:16:53.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:53.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.562 issued rwts: total=5120,5515,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.562 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.562 job1: (groupid=0, jobs=1): err= 0: pid=1909615: Wed Oct 16 07:14:56 2024 00:16:53.563 read: IOPS=3173, BW=12.4MiB/s (13.0MB/s)(12.5MiB/1010msec) 00:16:53.563 slat (usec): min=2, max=19764, avg=177.60, stdev=990.15 00:16:53.563 clat (usec): min=630, max=55698, avg=22583.75, stdev=10390.72 00:16:53.563 lat (usec): min=7215, max=55729, avg=22761.35, stdev=10431.73 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 8291], 5.00th=[10028], 10.00th=[10421], 20.00th=[11076], 00:16:53.563 | 30.00th=[15926], 40.00th=[19530], 50.00th=[22152], 60.00th=[23725], 00:16:53.563 | 70.00th=[25822], 80.00th=[31327], 90.00th=[36439], 95.00th=[43779], 00:16:53.563 | 99.00th=[52691], 99.50th=[52691], 99.90th=[52691], 99.95th=[52691], 00:16:53.563 | 99.99th=[55837] 00:16:53.563 write: IOPS=3548, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1010msec); 0 zone resets 00:16:53.563 slat (usec): min=3, max=20425, avg=115.47, stdev=753.15 00:16:53.563 clat (usec): min=6599, max=37702, avg=15298.12, stdev=6001.55 00:16:53.563 lat (usec): min=6604, max=39740, avg=15413.59, stdev=6019.94 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 6652], 5.00th=[ 9372], 10.00th=[10421], 20.00th=[11076], 00:16:53.563 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12911], 60.00th=[14746], 00:16:53.563 | 70.00th=[16909], 80.00th=[19530], 90.00th=[22676], 95.00th=[27132], 00:16:53.563 | 99.00th=[37487], 99.50th=[37487], 99.90th=[37487], 99.95th=[37487], 00:16:53.563 | 99.99th=[37487] 00:16:53.563 bw ( KiB/s): min=12288, max=16384, per=20.69%, avg=14336.00, stdev=2896.31, samples=2 00:16:53.563 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:16:53.563 lat (usec) : 750=0.01% 00:16:53.563 lat (msec) : 10=6.25%, 20=58.04%, 50=35.07%, 100=0.63% 00:16:53.563 cpu : usr=2.38%, sys=5.05%, ctx=256, majf=0, minf=1 00:16:53.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:53.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.563 issued rwts: total=3205,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.563 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.563 job2: (groupid=0, jobs=1): err= 0: pid=1909647: Wed Oct 16 07:14:56 2024 00:16:53.563 read: IOPS=3552, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1009msec) 00:16:53.563 slat (usec): min=2, max=19566, avg=137.98, stdev=865.85 00:16:53.563 clat (usec): min=3197, max=54679, avg=18212.62, stdev=7537.67 00:16:53.563 lat (usec): min=3213, max=54692, avg=18350.60, stdev=7606.74 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 8291], 5.00th=[10159], 10.00th=[11994], 20.00th=[12649], 00:16:53.563 | 30.00th=[13173], 40.00th=[14484], 50.00th=[15795], 60.00th=[19268], 00:16:53.563 | 70.00th=[19792], 80.00th=[22938], 90.00th=[27395], 95.00th=[30016], 00:16:53.563 | 99.00th=[48497], 99.50th=[49021], 99.90th=[49021], 99.95th=[52691], 00:16:53.563 | 99.99th=[54789] 00:16:53.563 write: IOPS=3939, BW=15.4MiB/s (16.1MB/s)(15.5MiB/1009msec); 0 zone resets 00:16:53.563 slat (usec): min=3, max=11157, avg=112.42, stdev=712.63 00:16:53.563 clat (usec): min=509, max=43228, avg=15643.91, stdev=7316.68 00:16:53.563 lat (usec): min=529, max=43234, avg=15756.33, stdev=7359.19 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 2671], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[10945], 00:16:53.563 | 30.00th=[12387], 40.00th=[12911], 50.00th=[14222], 60.00th=[15664], 00:16:53.563 | 70.00th=[16909], 80.00th=[18220], 90.00th=[25035], 95.00th=[30278], 00:16:53.563 | 99.00th=[41681], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:16:53.563 | 99.99th=[43254] 00:16:53.563 bw ( KiB/s): min=15000, max=15776, per=22.20%, avg=15388.00, stdev=548.71, samples=2 00:16:53.563 iops : min= 3750, max= 3944, avg=3847.00, stdev=137.18, samples=2 00:16:53.563 lat (usec) : 750=0.05%, 1000=0.20% 00:16:53.563 lat (msec) : 2=0.17%, 4=1.05%, 10=7.74%, 20=67.61%, 50=23.15% 00:16:53.563 lat (msec) : 100=0.03% 00:16:53.563 cpu : usr=3.47%, sys=5.95%, ctx=275, majf=0, minf=1 00:16:53.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:53.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.563 issued rwts: total=3584,3975,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.563 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.563 job3: (groupid=0, jobs=1): err= 0: pid=1909658: Wed Oct 16 07:14:56 2024 00:16:53.563 read: IOPS=4051, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1011msec) 00:16:53.563 slat (usec): min=2, max=11858, avg=94.46, stdev=722.14 00:16:53.563 clat (usec): min=3856, max=31946, avg=12294.62, stdev=3617.45 00:16:53.563 lat (usec): min=3862, max=31975, avg=12389.08, stdev=3666.28 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 4047], 5.00th=[ 7635], 10.00th=[ 9372], 20.00th=[10814], 00:16:53.563 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:16:53.563 | 70.00th=[12518], 80.00th=[13698], 90.00th=[16450], 95.00th=[19006], 00:16:53.563 | 99.00th=[28705], 99.50th=[30540], 99.90th=[31851], 99.95th=[31851], 00:16:53.563 | 99.99th=[31851] 00:16:53.563 write: IOPS=4393, BW=17.2MiB/s (18.0MB/s)(17.4MiB/1011msec); 0 zone resets 00:16:53.563 slat (usec): min=3, max=17309, avg=120.24, stdev=893.80 00:16:53.563 clat (usec): min=1801, max=96962, avg=17180.97, stdev=15132.24 00:16:53.563 lat (usec): min=1807, max=96967, avg=17301.21, stdev=15189.03 00:16:53.563 clat percentiles (usec): 00:16:53.563 | 1.00th=[ 3195], 5.00th=[ 4752], 10.00th=[ 7177], 20.00th=[10028], 00:16:53.563 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11863], 60.00th=[12649], 00:16:53.563 | 70.00th=[14615], 80.00th=[18744], 90.00th=[36963], 95.00th=[54264], 00:16:53.563 | 99.00th=[83362], 99.50th=[90702], 99.90th=[96994], 99.95th=[96994], 00:16:53.563 | 99.99th=[96994] 00:16:53.563 bw ( KiB/s): min=15816, max=18704, per=24.91%, avg=17260.00, stdev=2042.12, samples=2 00:16:53.563 iops : min= 3954, max= 4676, avg=4315.00, stdev=510.53, samples=2 00:16:53.563 lat (msec) : 2=0.19%, 4=1.72%, 10=14.64%, 20=73.13%, 50=6.88% 00:16:53.563 lat (msec) : 100=3.44% 00:16:53.563 cpu : usr=2.28%, sys=4.95%, ctx=333, majf=0, minf=1 00:16:53.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:53.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:53.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:53.563 issued rwts: total=4096,4442,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:53.563 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:53.563 00:16:53.563 Run status group 0 (all jobs): 00:16:53.563 READ: bw=61.8MiB/s (64.8MB/s), 12.4MiB/s-19.8MiB/s (13.0MB/s-20.8MB/s), io=62.5MiB (65.6MB), run=1009-1011msec 00:16:53.563 WRITE: bw=67.7MiB/s (71.0MB/s), 13.9MiB/s-21.4MiB/s (14.5MB/s-22.4MB/s), io=68.4MiB (71.7MB), run=1009-1011msec 00:16:53.563 00:16:53.563 Disk stats (read/write): 00:16:53.563 nvme0n1: ios=4482/4608, merge=0/0, ticks=39669/45433, in_queue=85102, util=86.07% 00:16:53.563 nvme0n2: ios=2808/3072, merge=0/0, ticks=18787/14868, in_queue=33655, util=96.44% 00:16:53.563 nvme0n3: ios=3002/3072, merge=0/0, ticks=31043/32827, in_queue=63870, util=97.49% 00:16:53.563 nvme0n4: ios=3129/3584, merge=0/0, ticks=33021/45692, in_queue=78713, util=97.47% 00:16:53.563 07:14:56 -- target/fio.sh@55 -- # sync 00:16:53.563 07:14:56 -- target/fio.sh@59 -- # fio_pid=1909836 00:16:53.563 07:14:56 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:53.563 07:14:56 -- target/fio.sh@61 -- # sleep 3 00:16:53.563 [global] 00:16:53.563 thread=1 00:16:53.563 invalidate=1 00:16:53.563 rw=read 00:16:53.563 time_based=1 00:16:53.563 runtime=10 00:16:53.563 ioengine=libaio 00:16:53.563 direct=1 00:16:53.563 bs=4096 00:16:53.563 iodepth=1 00:16:53.563 norandommap=1 00:16:53.563 numjobs=1 00:16:53.563 00:16:53.563 [job0] 00:16:53.563 filename=/dev/nvme0n1 00:16:53.563 [job1] 00:16:53.563 filename=/dev/nvme0n2 00:16:53.563 [job2] 00:16:53.563 filename=/dev/nvme0n3 00:16:53.563 [job3] 00:16:53.563 filename=/dev/nvme0n4 00:16:53.563 Could not set queue depth (nvme0n1) 00:16:53.563 Could not set queue depth (nvme0n2) 00:16:53.563 Could not set queue depth (nvme0n3) 00:16:53.563 Could not set queue depth (nvme0n4) 00:16:53.563 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.563 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.563 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.563 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.563 fio-3.35 00:16:53.563 Starting 4 threads 00:16:56.843 07:14:59 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:56.843 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=45498368, buflen=4096 00:16:56.843 fio: pid=1909932, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:56.843 07:14:59 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:56.843 07:14:59 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:56.843 07:14:59 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:56.843 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=40882176, buflen=4096 00:16:56.843 fio: pid=1909931, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:57.102 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=40914944, buflen=4096 00:16:57.102 fio: pid=1909928, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:57.102 07:15:00 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:57.102 07:15:00 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:57.359 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=9891840, buflen=4096 00:16:57.359 fio: pid=1909929, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:57.359 07:15:00 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:57.360 07:15:00 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:57.618 00:16:57.618 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1909928: Wed Oct 16 07:15:00 2024 00:16:57.618 read: IOPS=2899, BW=11.3MiB/s (11.9MB/s)(39.0MiB/3446msec) 00:16:57.618 slat (usec): min=5, max=16002, avg=15.45, stdev=230.85 00:16:57.618 clat (usec): min=185, max=41212, avg=324.53, stdev=1344.78 00:16:57.618 lat (usec): min=192, max=41228, avg=339.99, stdev=1364.45 00:16:57.618 clat percentiles (usec): 00:16:57.618 | 1.00th=[ 212], 5.00th=[ 223], 10.00th=[ 229], 20.00th=[ 237], 00:16:57.618 | 30.00th=[ 245], 40.00th=[ 253], 50.00th=[ 265], 60.00th=[ 273], 00:16:57.618 | 70.00th=[ 281], 80.00th=[ 293], 90.00th=[ 347], 95.00th=[ 445], 00:16:57.618 | 99.00th=[ 578], 99.50th=[ 619], 99.90th=[40633], 99.95th=[40633], 00:16:57.618 | 99.99th=[41157] 00:16:57.618 bw ( KiB/s): min= 8256, max=14704, per=31.38%, avg=11316.00, stdev=2293.12, samples=6 00:16:57.618 iops : min= 2064, max= 3676, avg=2829.00, stdev=573.28, samples=6 00:16:57.618 lat (usec) : 250=36.52%, 500=60.47%, 750=2.86%, 1000=0.01% 00:16:57.618 lat (msec) : 2=0.01%, 10=0.01%, 50=0.11% 00:16:57.618 cpu : usr=1.57%, sys=5.31%, ctx=9997, majf=0, minf=1 00:16:57.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:57.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.618 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.618 issued rwts: total=9990,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:57.618 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1909929: Wed Oct 16 07:15:00 2024 00:16:57.618 read: IOPS=650, BW=2600KiB/s (2663kB/s)(9660KiB/3715msec) 00:16:57.618 slat (usec): min=4, max=12889, avg=19.82, stdev=318.40 00:16:57.618 clat (usec): min=166, max=42141, avg=1511.59, stdev=7024.88 00:16:57.618 lat (usec): min=170, max=55030, avg=1531.42, stdev=7084.69 00:16:57.618 clat percentiles (usec): 00:16:57.618 | 1.00th=[ 172], 5.00th=[ 178], 10.00th=[ 184], 20.00th=[ 194], 00:16:57.618 | 30.00th=[ 208], 40.00th=[ 227], 50.00th=[ 247], 60.00th=[ 265], 00:16:57.618 | 70.00th=[ 289], 80.00th=[ 338], 90.00th=[ 396], 95.00th=[ 469], 00:16:57.618 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:57.618 | 99.99th=[42206] 00:16:57.618 bw ( KiB/s): min= 96, max= 4608, per=5.81%, avg=2094.00, stdev=1676.95, samples=7 00:16:57.618 iops : min= 24, max= 1152, avg=523.43, stdev=419.22, samples=7 00:16:57.618 lat (usec) : 250=52.52%, 500=43.25%, 750=1.03% 00:16:57.618 lat (msec) : 2=0.04%, 4=0.04%, 50=3.06% 00:16:57.618 cpu : usr=0.24%, sys=0.83%, ctx=2420, majf=0, minf=1 00:16:57.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:57.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.618 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.618 issued rwts: total=2416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:57.618 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1909931: Wed Oct 16 07:15:00 2024 00:16:57.618 read: IOPS=3140, BW=12.3MiB/s (12.9MB/s)(39.0MiB/3178msec) 00:16:57.618 slat (usec): min=4, max=11709, avg=13.66, stdev=154.59 00:16:57.618 clat (usec): min=186, max=42008, avg=299.51, stdev=1416.56 00:16:57.618 lat (usec): min=193, max=42015, avg=313.18, stdev=1425.07 00:16:57.618 clat percentiles (usec): 00:16:57.618 | 1.00th=[ 198], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 217], 00:16:57.618 | 30.00th=[ 225], 40.00th=[ 235], 50.00th=[ 245], 60.00th=[ 253], 00:16:57.618 | 70.00th=[ 262], 80.00th=[ 273], 90.00th=[ 297], 95.00th=[ 310], 00:16:57.618 | 99.00th=[ 355], 99.50th=[ 379], 99.90th=[40633], 99.95th=[41157], 00:16:57.618 | 99.99th=[42206] 00:16:57.618 bw ( KiB/s): min= 1448, max=15552, per=34.69%, avg=12510.67, stdev=5467.54, samples=6 00:16:57.618 iops : min= 362, max= 3888, avg=3127.67, stdev=1366.88, samples=6 00:16:57.618 lat (usec) : 250=57.22%, 500=42.50%, 750=0.08%, 1000=0.01% 00:16:57.618 lat (msec) : 2=0.03%, 10=0.02%, 20=0.01%, 50=0.12% 00:16:57.618 cpu : usr=2.58%, sys=5.16%, ctx=9984, majf=0, minf=2 00:16:57.619 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:57.619 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.619 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.619 issued rwts: total=9982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.619 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:57.619 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1909932: Wed Oct 16 07:15:00 2024 00:16:57.619 read: IOPS=3837, BW=15.0MiB/s (15.7MB/s)(43.4MiB/2895msec) 00:16:57.619 slat (nsec): min=4303, max=56785, avg=9747.46, stdev=5294.83 00:16:57.619 clat (usec): min=178, max=41485, avg=247.91, stdev=393.54 00:16:57.619 lat (usec): min=183, max=41504, avg=257.66, stdev=393.79 00:16:57.619 clat percentiles (usec): 00:16:57.619 | 1.00th=[ 196], 5.00th=[ 206], 10.00th=[ 212], 20.00th=[ 221], 00:16:57.619 | 30.00th=[ 227], 40.00th=[ 231], 50.00th=[ 237], 60.00th=[ 241], 00:16:57.619 | 70.00th=[ 247], 80.00th=[ 255], 90.00th=[ 281], 95.00th=[ 310], 00:16:57.619 | 99.00th=[ 449], 99.50th=[ 486], 99.90th=[ 545], 99.95th=[ 553], 00:16:57.619 | 99.99th=[ 1270] 00:16:57.619 bw ( KiB/s): min=14216, max=16712, per=42.82%, avg=15443.20, stdev=1075.75, samples=5 00:16:57.619 iops : min= 3554, max= 4178, avg=3860.80, stdev=268.94, samples=5 00:16:57.619 lat (usec) : 250=73.53%, 500=26.09%, 750=0.35% 00:16:57.619 lat (msec) : 2=0.01%, 50=0.01% 00:16:57.619 cpu : usr=1.52%, sys=4.32%, ctx=11109, majf=0, minf=2 00:16:57.619 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:57.619 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.619 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.619 issued rwts: total=11109,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.619 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:57.619 00:16:57.619 Run status group 0 (all jobs): 00:16:57.619 READ: bw=35.2MiB/s (36.9MB/s), 2600KiB/s-15.0MiB/s (2663kB/s-15.7MB/s), io=131MiB (137MB), run=2895-3715msec 00:16:57.619 00:16:57.619 Disk stats (read/write): 00:16:57.619 nvme0n1: ios=9848/0, merge=0/0, ticks=3378/0, in_queue=3378, util=99.06% 00:16:57.619 nvme0n2: ios=1938/0, merge=0/0, ticks=4880/0, in_queue=4880, util=99.36% 00:16:57.619 nvme0n3: ios=9755/0, merge=0/0, ticks=2822/0, in_queue=2822, util=96.13% 00:16:57.619 nvme0n4: ios=10975/0, merge=0/0, ticks=2626/0, in_queue=2626, util=96.75% 00:16:57.619 07:15:00 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:57.619 07:15:00 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:58.235 07:15:00 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:58.235 07:15:00 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:58.235 07:15:01 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:58.235 07:15:01 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:58.532 07:15:01 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:58.532 07:15:01 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:58.816 07:15:01 -- target/fio.sh@69 -- # fio_status=0 00:16:58.816 07:15:01 -- target/fio.sh@70 -- # wait 1909836 00:16:58.816 07:15:01 -- target/fio.sh@70 -- # fio_status=4 00:16:58.816 07:15:01 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:58.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:58.816 07:15:01 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:58.816 07:15:01 -- common/autotest_common.sh@1198 -- # local i=0 00:16:58.816 07:15:01 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:58.816 07:15:01 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:59.073 07:15:01 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:59.073 07:15:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:59.073 07:15:01 -- common/autotest_common.sh@1210 -- # return 0 00:16:59.073 07:15:01 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:59.073 07:15:01 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:59.073 nvmf hotplug test: fio failed as expected 00:16:59.073 07:15:01 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:59.330 07:15:02 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:59.330 07:15:02 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:59.330 07:15:02 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:59.330 07:15:02 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:59.330 07:15:02 -- target/fio.sh@91 -- # nvmftestfini 00:16:59.330 07:15:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:59.330 07:15:02 -- nvmf/common.sh@116 -- # sync 00:16:59.330 07:15:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:59.330 07:15:02 -- nvmf/common.sh@119 -- # set +e 00:16:59.330 07:15:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:59.330 07:15:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:59.330 rmmod nvme_tcp 00:16:59.330 rmmod nvme_fabrics 00:16:59.330 rmmod nvme_keyring 00:16:59.330 07:15:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:59.330 07:15:02 -- nvmf/common.sh@123 -- # set -e 00:16:59.330 07:15:02 -- nvmf/common.sh@124 -- # return 0 00:16:59.330 07:15:02 -- nvmf/common.sh@477 -- # '[' -n 1907614 ']' 00:16:59.330 07:15:02 -- nvmf/common.sh@478 -- # killprocess 1907614 00:16:59.330 07:15:02 -- common/autotest_common.sh@926 -- # '[' -z 1907614 ']' 00:16:59.330 07:15:02 -- common/autotest_common.sh@930 -- # kill -0 1907614 00:16:59.330 07:15:02 -- common/autotest_common.sh@931 -- # uname 00:16:59.330 07:15:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:59.330 07:15:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1907614 00:16:59.330 07:15:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:59.330 07:15:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:59.330 07:15:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1907614' 00:16:59.330 killing process with pid 1907614 00:16:59.330 07:15:02 -- common/autotest_common.sh@945 -- # kill 1907614 00:16:59.330 07:15:02 -- common/autotest_common.sh@950 -- # wait 1907614 00:16:59.588 07:15:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:59.588 07:15:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:59.588 07:15:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:59.588 07:15:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:59.588 07:15:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:59.588 07:15:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:59.588 07:15:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:59.588 07:15:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.120 07:15:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:02.120 00:17:02.120 real 0m24.406s 00:17:02.120 user 1m26.328s 00:17:02.120 sys 0m6.857s 00:17:02.120 07:15:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:02.120 07:15:04 -- common/autotest_common.sh@10 -- # set +x 00:17:02.120 ************************************ 00:17:02.120 END TEST nvmf_fio_target 00:17:02.120 ************************************ 00:17:02.120 07:15:04 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:02.120 07:15:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:02.120 07:15:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:02.120 07:15:04 -- common/autotest_common.sh@10 -- # set +x 00:17:02.120 ************************************ 00:17:02.120 START TEST nvmf_bdevio 00:17:02.120 ************************************ 00:17:02.120 07:15:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:02.120 * Looking for test storage... 00:17:02.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:02.120 07:15:04 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:02.120 07:15:04 -- nvmf/common.sh@7 -- # uname -s 00:17:02.120 07:15:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:02.120 07:15:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:02.120 07:15:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:02.120 07:15:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:02.120 07:15:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:02.120 07:15:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:02.120 07:15:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:02.120 07:15:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:02.120 07:15:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:02.120 07:15:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:02.120 07:15:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.120 07:15:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.120 07:15:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:02.120 07:15:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:02.120 07:15:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:02.120 07:15:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:02.120 07:15:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:02.120 07:15:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:02.120 07:15:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:02.120 07:15:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.121 07:15:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.121 07:15:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.121 07:15:04 -- paths/export.sh@5 -- # export PATH 00:17:02.121 07:15:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.121 07:15:04 -- nvmf/common.sh@46 -- # : 0 00:17:02.121 07:15:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:02.121 07:15:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:02.121 07:15:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:02.121 07:15:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:02.121 07:15:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:02.121 07:15:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:02.121 07:15:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:02.121 07:15:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:02.121 07:15:04 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:02.121 07:15:04 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:02.121 07:15:04 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:02.121 07:15:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:02.121 07:15:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:02.121 07:15:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:02.121 07:15:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:02.121 07:15:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:02.121 07:15:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.121 07:15:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.121 07:15:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.121 07:15:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:02.121 07:15:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:02.121 07:15:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:02.121 07:15:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.019 07:15:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:04.019 07:15:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:04.019 07:15:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:04.019 07:15:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:04.019 07:15:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:04.019 07:15:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:04.019 07:15:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:04.019 07:15:06 -- nvmf/common.sh@294 -- # net_devs=() 00:17:04.019 07:15:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:04.019 07:15:06 -- nvmf/common.sh@295 -- # e810=() 00:17:04.019 07:15:06 -- nvmf/common.sh@295 -- # local -ga e810 00:17:04.019 07:15:06 -- nvmf/common.sh@296 -- # x722=() 00:17:04.019 07:15:06 -- nvmf/common.sh@296 -- # local -ga x722 00:17:04.019 07:15:06 -- nvmf/common.sh@297 -- # mlx=() 00:17:04.019 07:15:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:04.019 07:15:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:04.019 07:15:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:04.019 07:15:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:04.019 07:15:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.019 07:15:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:04.019 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:04.019 07:15:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.019 07:15:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:04.019 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:04.019 07:15:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.019 07:15:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.019 07:15:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.019 07:15:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:04.019 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:04.019 07:15:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.019 07:15:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.019 07:15:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.019 07:15:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.019 07:15:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:04.019 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:04.019 07:15:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.019 07:15:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:04.019 07:15:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:04.019 07:15:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:04.019 07:15:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:04.019 07:15:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:04.019 07:15:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:04.019 07:15:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:04.019 07:15:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:04.019 07:15:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:04.019 07:15:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:04.019 07:15:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:04.019 07:15:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:04.019 07:15:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:04.019 07:15:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:04.019 07:15:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:04.019 07:15:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:04.019 07:15:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:04.019 07:15:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:04.019 07:15:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:04.019 07:15:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:04.020 07:15:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:04.020 07:15:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:04.020 07:15:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:04.020 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:04.020 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:17:04.020 00:17:04.020 --- 10.0.0.2 ping statistics --- 00:17:04.020 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.020 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:17:04.020 07:15:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:04.020 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:04.020 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:17:04.020 00:17:04.020 --- 10.0.0.1 ping statistics --- 00:17:04.020 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.020 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:17:04.020 07:15:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:04.020 07:15:06 -- nvmf/common.sh@410 -- # return 0 00:17:04.020 07:15:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:04.020 07:15:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:04.020 07:15:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:04.020 07:15:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:04.020 07:15:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:04.020 07:15:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:04.020 07:15:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:04.020 07:15:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:04.020 07:15:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:04.020 07:15:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:04.020 07:15:06 -- common/autotest_common.sh@10 -- # set +x 00:17:04.020 07:15:06 -- nvmf/common.sh@469 -- # nvmfpid=1912691 00:17:04.020 07:15:06 -- nvmf/common.sh@470 -- # waitforlisten 1912691 00:17:04.020 07:15:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:04.020 07:15:06 -- common/autotest_common.sh@819 -- # '[' -z 1912691 ']' 00:17:04.020 07:15:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:04.020 07:15:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:04.020 07:15:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:04.020 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:04.020 07:15:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:04.020 07:15:06 -- common/autotest_common.sh@10 -- # set +x 00:17:04.020 [2024-10-16 07:15:06.819622] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:04.020 [2024-10-16 07:15:06.819711] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:04.020 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.020 [2024-10-16 07:15:06.887264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:04.278 [2024-10-16 07:15:07.001694] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:04.278 [2024-10-16 07:15:07.001852] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:04.278 [2024-10-16 07:15:07.001870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:04.278 [2024-10-16 07:15:07.001882] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:04.278 [2024-10-16 07:15:07.001985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:04.278 [2024-10-16 07:15:07.002060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:04.278 [2024-10-16 07:15:07.002109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:04.278 [2024-10-16 07:15:07.002112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:05.209 07:15:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:05.209 07:15:07 -- common/autotest_common.sh@852 -- # return 0 00:17:05.209 07:15:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:05.209 07:15:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:05.209 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.209 07:15:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:05.209 07:15:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:05.209 07:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:05.209 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.209 [2024-10-16 07:15:07.841411] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:05.209 07:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:05.209 07:15:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:05.209 07:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:05.209 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.209 Malloc0 00:17:05.209 07:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:05.209 07:15:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:05.209 07:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:05.209 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.209 07:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:05.209 07:15:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:05.209 07:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:05.210 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.210 07:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:05.210 07:15:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:05.210 07:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:05.210 07:15:07 -- common/autotest_common.sh@10 -- # set +x 00:17:05.210 [2024-10-16 07:15:07.893110] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:05.210 07:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:05.210 07:15:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:05.210 07:15:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:05.210 07:15:07 -- nvmf/common.sh@520 -- # config=() 00:17:05.210 07:15:07 -- nvmf/common.sh@520 -- # local subsystem config 00:17:05.210 07:15:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:05.210 07:15:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:05.210 { 00:17:05.210 "params": { 00:17:05.210 "name": "Nvme$subsystem", 00:17:05.210 "trtype": "$TEST_TRANSPORT", 00:17:05.210 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:05.210 "adrfam": "ipv4", 00:17:05.210 "trsvcid": "$NVMF_PORT", 00:17:05.210 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:05.210 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:05.210 "hdgst": ${hdgst:-false}, 00:17:05.210 "ddgst": ${ddgst:-false} 00:17:05.210 }, 00:17:05.210 "method": "bdev_nvme_attach_controller" 00:17:05.210 } 00:17:05.210 EOF 00:17:05.210 )") 00:17:05.210 07:15:07 -- nvmf/common.sh@542 -- # cat 00:17:05.210 07:15:07 -- nvmf/common.sh@544 -- # jq . 00:17:05.210 07:15:07 -- nvmf/common.sh@545 -- # IFS=, 00:17:05.210 07:15:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:05.210 "params": { 00:17:05.210 "name": "Nvme1", 00:17:05.210 "trtype": "tcp", 00:17:05.210 "traddr": "10.0.0.2", 00:17:05.210 "adrfam": "ipv4", 00:17:05.210 "trsvcid": "4420", 00:17:05.210 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:05.210 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:05.210 "hdgst": false, 00:17:05.210 "ddgst": false 00:17:05.210 }, 00:17:05.210 "method": "bdev_nvme_attach_controller" 00:17:05.210 }' 00:17:05.210 [2024-10-16 07:15:07.934635] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:05.210 [2024-10-16 07:15:07.934736] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1913179 ] 00:17:05.210 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.210 [2024-10-16 07:15:07.996367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:05.210 [2024-10-16 07:15:08.105317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:05.210 [2024-10-16 07:15:08.105367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:05.210 [2024-10-16 07:15:08.105370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:05.467 [2024-10-16 07:15:08.275420] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:05.467 [2024-10-16 07:15:08.275485] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:05.467 I/O targets: 00:17:05.467 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:05.467 00:17:05.467 00:17:05.467 CUnit - A unit testing framework for C - Version 2.1-3 00:17:05.467 http://cunit.sourceforge.net/ 00:17:05.467 00:17:05.467 00:17:05.467 Suite: bdevio tests on: Nvme1n1 00:17:05.467 Test: blockdev write read block ...passed 00:17:05.467 Test: blockdev write zeroes read block ...passed 00:17:05.467 Test: blockdev write zeroes read no split ...passed 00:17:05.726 Test: blockdev write zeroes read split ...passed 00:17:05.726 Test: blockdev write zeroes read split partial ...passed 00:17:05.726 Test: blockdev reset ...[2024-10-16 07:15:08.473612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:05.726 [2024-10-16 07:15:08.473725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cbf20 (9): Bad file descriptor 00:17:05.726 [2024-10-16 07:15:08.525013] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:05.726 passed 00:17:05.726 Test: blockdev write read 8 blocks ...passed 00:17:05.726 Test: blockdev write read size > 128k ...passed 00:17:05.726 Test: blockdev write read invalid size ...passed 00:17:05.726 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:05.726 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:05.726 Test: blockdev write read max offset ...passed 00:17:05.726 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:05.726 Test: blockdev writev readv 8 blocks ...passed 00:17:05.726 Test: blockdev writev readv 30 x 1block ...passed 00:17:05.984 Test: blockdev writev readv block ...passed 00:17:05.984 Test: blockdev writev readv size > 128k ...passed 00:17:05.984 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:05.984 Test: blockdev comparev and writev ...[2024-10-16 07:15:08.700578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.700614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.700638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.700654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.700986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.701044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.701424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.701468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.701859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.701903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:05.984 [2024-10-16 07:15:08.701918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:05.984 passed 00:17:05.984 Test: blockdev nvme passthru rw ...passed 00:17:05.984 Test: blockdev nvme passthru vendor specific ...[2024-10-16 07:15:08.786013] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.984 [2024-10-16 07:15:08.786040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.786183] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.984 [2024-10-16 07:15:08.786212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.786352] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.984 [2024-10-16 07:15:08.786374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:05.984 [2024-10-16 07:15:08.786508] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:05.984 [2024-10-16 07:15:08.786531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:05.984 passed 00:17:05.984 Test: blockdev nvme admin passthru ...passed 00:17:05.984 Test: blockdev copy ...passed 00:17:05.984 00:17:05.984 Run Summary: Type Total Ran Passed Failed Inactive 00:17:05.984 suites 1 1 n/a 0 0 00:17:05.984 tests 23 23 23 0 0 00:17:05.984 asserts 152 152 152 0 n/a 00:17:05.984 00:17:05.984 Elapsed time = 1.141 seconds 00:17:06.242 07:15:09 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:06.242 07:15:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:06.242 07:15:09 -- common/autotest_common.sh@10 -- # set +x 00:17:06.242 07:15:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:06.242 07:15:09 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:06.242 07:15:09 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:06.242 07:15:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:06.242 07:15:09 -- nvmf/common.sh@116 -- # sync 00:17:06.242 07:15:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:06.242 07:15:09 -- nvmf/common.sh@119 -- # set +e 00:17:06.242 07:15:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:06.242 07:15:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:06.242 rmmod nvme_tcp 00:17:06.242 rmmod nvme_fabrics 00:17:06.242 rmmod nvme_keyring 00:17:06.242 07:15:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:06.242 07:15:09 -- nvmf/common.sh@123 -- # set -e 00:17:06.242 07:15:09 -- nvmf/common.sh@124 -- # return 0 00:17:06.242 07:15:09 -- nvmf/common.sh@477 -- # '[' -n 1912691 ']' 00:17:06.242 07:15:09 -- nvmf/common.sh@478 -- # killprocess 1912691 00:17:06.242 07:15:09 -- common/autotest_common.sh@926 -- # '[' -z 1912691 ']' 00:17:06.242 07:15:09 -- common/autotest_common.sh@930 -- # kill -0 1912691 00:17:06.242 07:15:09 -- common/autotest_common.sh@931 -- # uname 00:17:06.242 07:15:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:06.242 07:15:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1912691 00:17:06.242 07:15:09 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:17:06.242 07:15:09 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:17:06.242 07:15:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1912691' 00:17:06.242 killing process with pid 1912691 00:17:06.242 07:15:09 -- common/autotest_common.sh@945 -- # kill 1912691 00:17:06.242 07:15:09 -- common/autotest_common.sh@950 -- # wait 1912691 00:17:06.808 07:15:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:06.808 07:15:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:06.808 07:15:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:06.808 07:15:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:06.808 07:15:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:06.808 07:15:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.808 07:15:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.808 07:15:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.709 07:15:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:08.709 00:17:08.709 real 0m7.013s 00:17:08.709 user 0m12.615s 00:17:08.709 sys 0m2.149s 00:17:08.709 07:15:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:08.709 07:15:11 -- common/autotest_common.sh@10 -- # set +x 00:17:08.709 ************************************ 00:17:08.709 END TEST nvmf_bdevio 00:17:08.709 ************************************ 00:17:08.709 07:15:11 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:08.709 07:15:11 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:08.709 07:15:11 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:17:08.709 07:15:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:08.709 07:15:11 -- common/autotest_common.sh@10 -- # set +x 00:17:08.709 ************************************ 00:17:08.709 START TEST nvmf_bdevio_no_huge 00:17:08.709 ************************************ 00:17:08.709 07:15:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:08.709 * Looking for test storage... 00:17:08.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:08.709 07:15:11 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:08.709 07:15:11 -- nvmf/common.sh@7 -- # uname -s 00:17:08.709 07:15:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:08.709 07:15:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:08.709 07:15:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:08.709 07:15:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:08.709 07:15:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:08.709 07:15:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:08.709 07:15:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:08.709 07:15:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:08.709 07:15:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:08.709 07:15:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:08.709 07:15:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.709 07:15:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.709 07:15:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:08.709 07:15:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:08.709 07:15:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:08.709 07:15:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:08.709 07:15:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:08.709 07:15:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:08.709 07:15:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:08.709 07:15:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.709 07:15:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.710 07:15:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.710 07:15:11 -- paths/export.sh@5 -- # export PATH 00:17:08.710 07:15:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.710 07:15:11 -- nvmf/common.sh@46 -- # : 0 00:17:08.710 07:15:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:08.710 07:15:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:08.710 07:15:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:08.710 07:15:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:08.710 07:15:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:08.710 07:15:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:08.710 07:15:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:08.710 07:15:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:08.710 07:15:11 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:08.710 07:15:11 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:08.710 07:15:11 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:08.710 07:15:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:08.710 07:15:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:08.710 07:15:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:08.710 07:15:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:08.710 07:15:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:08.710 07:15:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.710 07:15:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.710 07:15:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.710 07:15:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:08.710 07:15:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:08.710 07:15:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:08.710 07:15:11 -- common/autotest_common.sh@10 -- # set +x 00:17:11.241 07:15:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:11.241 07:15:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:11.241 07:15:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:11.241 07:15:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:11.241 07:15:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:11.241 07:15:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:11.241 07:15:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:11.241 07:15:13 -- nvmf/common.sh@294 -- # net_devs=() 00:17:11.241 07:15:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:11.241 07:15:13 -- nvmf/common.sh@295 -- # e810=() 00:17:11.241 07:15:13 -- nvmf/common.sh@295 -- # local -ga e810 00:17:11.241 07:15:13 -- nvmf/common.sh@296 -- # x722=() 00:17:11.241 07:15:13 -- nvmf/common.sh@296 -- # local -ga x722 00:17:11.241 07:15:13 -- nvmf/common.sh@297 -- # mlx=() 00:17:11.241 07:15:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:11.241 07:15:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:11.241 07:15:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:11.241 07:15:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:11.241 07:15:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:11.241 07:15:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:11.241 07:15:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:11.241 07:15:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:11.241 07:15:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.241 07:15:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:11.241 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:11.241 07:15:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.242 07:15:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:11.242 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:11.242 07:15:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:11.242 07:15:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.242 07:15:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.242 07:15:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.242 07:15:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.242 07:15:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:11.242 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:11.242 07:15:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.242 07:15:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.242 07:15:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.242 07:15:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.242 07:15:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.242 07:15:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:11.242 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:11.242 07:15:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.242 07:15:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:11.242 07:15:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:11.242 07:15:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:11.242 07:15:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:11.242 07:15:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:11.242 07:15:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:11.242 07:15:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:11.242 07:15:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:11.242 07:15:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:11.242 07:15:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:11.242 07:15:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:11.242 07:15:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:11.242 07:15:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:11.242 07:15:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:11.242 07:15:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:11.242 07:15:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:11.242 07:15:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:11.242 07:15:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:11.242 07:15:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:11.242 07:15:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:11.242 07:15:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:11.242 07:15:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:11.242 07:15:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:11.242 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:11.242 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.374 ms 00:17:11.242 00:17:11.242 --- 10.0.0.2 ping statistics --- 00:17:11.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:11.242 rtt min/avg/max/mdev = 0.374/0.374/0.374/0.000 ms 00:17:11.242 07:15:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:11.242 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:11.242 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:17:11.242 00:17:11.242 --- 10.0.0.1 ping statistics --- 00:17:11.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:11.242 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:17:11.242 07:15:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:11.242 07:15:13 -- nvmf/common.sh@410 -- # return 0 00:17:11.242 07:15:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:11.242 07:15:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:11.242 07:15:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:11.242 07:15:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:11.242 07:15:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:11.242 07:15:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:11.242 07:15:13 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:11.242 07:15:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:11.242 07:15:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:11.242 07:15:13 -- common/autotest_common.sh@10 -- # set +x 00:17:11.242 07:15:13 -- nvmf/common.sh@469 -- # nvmfpid=1915453 00:17:11.242 07:15:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:11.242 07:15:13 -- nvmf/common.sh@470 -- # waitforlisten 1915453 00:17:11.242 07:15:13 -- common/autotest_common.sh@819 -- # '[' -z 1915453 ']' 00:17:11.242 07:15:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:11.242 07:15:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:11.242 07:15:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:11.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:11.242 07:15:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:11.242 07:15:13 -- common/autotest_common.sh@10 -- # set +x 00:17:11.242 [2024-10-16 07:15:14.028078] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:11.242 [2024-10-16 07:15:14.028148] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:11.242 [2024-10-16 07:15:14.108139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:11.500 [2024-10-16 07:15:14.254530] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:11.500 [2024-10-16 07:15:14.254689] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:11.500 [2024-10-16 07:15:14.254713] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:11.500 [2024-10-16 07:15:14.254758] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:11.500 [2024-10-16 07:15:14.254908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:11.500 [2024-10-16 07:15:14.254973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:11.500 [2024-10-16 07:15:14.255038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:11.500 [2024-10-16 07:15:14.255045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:12.434 07:15:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:12.434 07:15:15 -- common/autotest_common.sh@852 -- # return 0 00:17:12.434 07:15:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:12.434 07:15:15 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 07:15:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:12.434 07:15:15 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:12.434 07:15:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 [2024-10-16 07:15:15.094241] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:12.434 07:15:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:12.434 07:15:15 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:12.434 07:15:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 Malloc0 00:17:12.434 07:15:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:12.434 07:15:15 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:12.434 07:15:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 07:15:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:12.434 07:15:15 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:12.434 07:15:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 07:15:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:12.434 07:15:15 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:12.434 07:15:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:12.434 07:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.434 [2024-10-16 07:15:15.132527] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:12.434 07:15:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:12.435 07:15:15 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:12.435 07:15:15 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:12.435 07:15:15 -- nvmf/common.sh@520 -- # config=() 00:17:12.435 07:15:15 -- nvmf/common.sh@520 -- # local subsystem config 00:17:12.435 07:15:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:12.435 07:15:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:12.435 { 00:17:12.435 "params": { 00:17:12.435 "name": "Nvme$subsystem", 00:17:12.435 "trtype": "$TEST_TRANSPORT", 00:17:12.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:12.435 "adrfam": "ipv4", 00:17:12.435 "trsvcid": "$NVMF_PORT", 00:17:12.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:12.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:12.435 "hdgst": ${hdgst:-false}, 00:17:12.435 "ddgst": ${ddgst:-false} 00:17:12.435 }, 00:17:12.435 "method": "bdev_nvme_attach_controller" 00:17:12.435 } 00:17:12.435 EOF 00:17:12.435 )") 00:17:12.435 07:15:15 -- nvmf/common.sh@542 -- # cat 00:17:12.435 07:15:15 -- nvmf/common.sh@544 -- # jq . 00:17:12.435 07:15:15 -- nvmf/common.sh@545 -- # IFS=, 00:17:12.435 07:15:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:12.435 "params": { 00:17:12.435 "name": "Nvme1", 00:17:12.435 "trtype": "tcp", 00:17:12.435 "traddr": "10.0.0.2", 00:17:12.435 "adrfam": "ipv4", 00:17:12.435 "trsvcid": "4420", 00:17:12.435 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.435 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:12.435 "hdgst": false, 00:17:12.435 "ddgst": false 00:17:12.435 }, 00:17:12.435 "method": "bdev_nvme_attach_controller" 00:17:12.435 }' 00:17:12.435 [2024-10-16 07:15:15.174808] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:12.435 [2024-10-16 07:15:15.174873] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1915609 ] 00:17:12.435 [2024-10-16 07:15:15.236582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:12.435 [2024-10-16 07:15:15.351187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:12.435 [2024-10-16 07:15:15.351240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:12.435 [2024-10-16 07:15:15.351244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:12.693 [2024-10-16 07:15:15.546363] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:12.693 [2024-10-16 07:15:15.546416] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:12.693 I/O targets: 00:17:12.693 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:12.693 00:17:12.693 00:17:12.693 CUnit - A unit testing framework for C - Version 2.1-3 00:17:12.693 http://cunit.sourceforge.net/ 00:17:12.693 00:17:12.693 00:17:12.693 Suite: bdevio tests on: Nvme1n1 00:17:12.693 Test: blockdev write read block ...passed 00:17:12.951 Test: blockdev write zeroes read block ...passed 00:17:12.951 Test: blockdev write zeroes read no split ...passed 00:17:12.951 Test: blockdev write zeroes read split ...passed 00:17:12.951 Test: blockdev write zeroes read split partial ...passed 00:17:12.951 Test: blockdev reset ...[2024-10-16 07:15:15.709625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:12.951 [2024-10-16 07:15:15.709740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xac47d0 (9): Bad file descriptor 00:17:12.951 [2024-10-16 07:15:15.726545] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:12.951 passed 00:17:12.951 Test: blockdev write read 8 blocks ...passed 00:17:12.951 Test: blockdev write read size > 128k ...passed 00:17:12.951 Test: blockdev write read invalid size ...passed 00:17:12.951 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:12.951 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:12.951 Test: blockdev write read max offset ...passed 00:17:12.951 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:12.951 Test: blockdev writev readv 8 blocks ...passed 00:17:12.951 Test: blockdev writev readv 30 x 1block ...passed 00:17:12.951 Test: blockdev writev readv block ...passed 00:17:13.209 Test: blockdev writev readv size > 128k ...passed 00:17:13.209 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:13.209 Test: blockdev comparev and writev ...[2024-10-16 07:15:15.937759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.937800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.937826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.937844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:15.938932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:13.209 [2024-10-16 07:15:15.938948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:13.209 passed 00:17:13.209 Test: blockdev nvme passthru rw ...passed 00:17:13.209 Test: blockdev nvme passthru vendor specific ...[2024-10-16 07:15:16.020996] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:13.209 [2024-10-16 07:15:16.021023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:16.021160] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:13.209 [2024-10-16 07:15:16.021182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:16.021316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:13.209 [2024-10-16 07:15:16.021338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:13.209 [2024-10-16 07:15:16.021479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:13.210 [2024-10-16 07:15:16.021502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:13.210 passed 00:17:13.210 Test: blockdev nvme admin passthru ...passed 00:17:13.210 Test: blockdev copy ...passed 00:17:13.210 00:17:13.210 Run Summary: Type Total Ran Passed Failed Inactive 00:17:13.210 suites 1 1 n/a 0 0 00:17:13.210 tests 23 23 23 0 0 00:17:13.210 asserts 152 152 152 0 n/a 00:17:13.210 00:17:13.210 Elapsed time = 1.069 seconds 00:17:13.776 07:15:16 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:13.776 07:15:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:13.776 07:15:16 -- common/autotest_common.sh@10 -- # set +x 00:17:13.776 07:15:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:13.776 07:15:16 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:13.776 07:15:16 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:13.776 07:15:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:13.776 07:15:16 -- nvmf/common.sh@116 -- # sync 00:17:13.776 07:15:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:13.776 07:15:16 -- nvmf/common.sh@119 -- # set +e 00:17:13.776 07:15:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:13.776 07:15:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:13.776 rmmod nvme_tcp 00:17:13.776 rmmod nvme_fabrics 00:17:13.776 rmmod nvme_keyring 00:17:13.776 07:15:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:13.776 07:15:16 -- nvmf/common.sh@123 -- # set -e 00:17:13.776 07:15:16 -- nvmf/common.sh@124 -- # return 0 00:17:13.776 07:15:16 -- nvmf/common.sh@477 -- # '[' -n 1915453 ']' 00:17:13.776 07:15:16 -- nvmf/common.sh@478 -- # killprocess 1915453 00:17:13.776 07:15:16 -- common/autotest_common.sh@926 -- # '[' -z 1915453 ']' 00:17:13.776 07:15:16 -- common/autotest_common.sh@930 -- # kill -0 1915453 00:17:13.776 07:15:16 -- common/autotest_common.sh@931 -- # uname 00:17:13.776 07:15:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:13.776 07:15:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1915453 00:17:13.776 07:15:16 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:17:13.776 07:15:16 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:17:13.776 07:15:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1915453' 00:17:13.776 killing process with pid 1915453 00:17:13.776 07:15:16 -- common/autotest_common.sh@945 -- # kill 1915453 00:17:13.776 07:15:16 -- common/autotest_common.sh@950 -- # wait 1915453 00:17:14.342 07:15:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:14.342 07:15:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:14.342 07:15:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:14.342 07:15:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:14.342 07:15:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:14.342 07:15:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:14.342 07:15:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:14.342 07:15:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:16.243 07:15:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:16.243 00:17:16.243 real 0m7.506s 00:17:16.243 user 0m13.553s 00:17:16.243 sys 0m2.714s 00:17:16.243 07:15:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:16.243 07:15:19 -- common/autotest_common.sh@10 -- # set +x 00:17:16.243 ************************************ 00:17:16.243 END TEST nvmf_bdevio_no_huge 00:17:16.243 ************************************ 00:17:16.243 07:15:19 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:16.243 07:15:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:16.243 07:15:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:16.243 07:15:19 -- common/autotest_common.sh@10 -- # set +x 00:17:16.243 ************************************ 00:17:16.243 START TEST nvmf_tls 00:17:16.243 ************************************ 00:17:16.244 07:15:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:16.244 * Looking for test storage... 00:17:16.244 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:16.244 07:15:19 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:16.244 07:15:19 -- nvmf/common.sh@7 -- # uname -s 00:17:16.244 07:15:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:16.244 07:15:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:16.244 07:15:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:16.244 07:15:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:16.244 07:15:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:16.244 07:15:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:16.244 07:15:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:16.244 07:15:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:16.244 07:15:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:16.244 07:15:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:16.244 07:15:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:16.244 07:15:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:16.244 07:15:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:16.244 07:15:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:16.244 07:15:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:16.244 07:15:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:16.244 07:15:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:16.244 07:15:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:16.244 07:15:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:16.244 07:15:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:16.244 07:15:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:16.244 07:15:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:16.244 07:15:19 -- paths/export.sh@5 -- # export PATH 00:17:16.244 07:15:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:16.244 07:15:19 -- nvmf/common.sh@46 -- # : 0 00:17:16.244 07:15:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:16.244 07:15:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:16.244 07:15:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:16.244 07:15:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:16.244 07:15:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:16.244 07:15:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:16.244 07:15:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:16.244 07:15:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:16.244 07:15:19 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:16.244 07:15:19 -- target/tls.sh@71 -- # nvmftestinit 00:17:16.244 07:15:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:16.244 07:15:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:16.244 07:15:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:16.244 07:15:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:16.244 07:15:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:16.244 07:15:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.244 07:15:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:16.244 07:15:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:16.244 07:15:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:16.244 07:15:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:16.244 07:15:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:16.244 07:15:19 -- common/autotest_common.sh@10 -- # set +x 00:17:18.776 07:15:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:18.776 07:15:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:18.776 07:15:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:18.776 07:15:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:18.776 07:15:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:18.776 07:15:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:18.776 07:15:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:18.776 07:15:21 -- nvmf/common.sh@294 -- # net_devs=() 00:17:18.776 07:15:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:18.776 07:15:21 -- nvmf/common.sh@295 -- # e810=() 00:17:18.776 07:15:21 -- nvmf/common.sh@295 -- # local -ga e810 00:17:18.776 07:15:21 -- nvmf/common.sh@296 -- # x722=() 00:17:18.776 07:15:21 -- nvmf/common.sh@296 -- # local -ga x722 00:17:18.776 07:15:21 -- nvmf/common.sh@297 -- # mlx=() 00:17:18.776 07:15:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:18.776 07:15:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:18.776 07:15:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:18.776 07:15:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:18.776 07:15:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:18.776 07:15:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:18.776 07:15:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:18.776 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:18.776 07:15:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:18.776 07:15:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:18.776 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:18.776 07:15:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:18.776 07:15:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:18.776 07:15:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.776 07:15:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:18.776 07:15:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.776 07:15:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:18.776 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:18.776 07:15:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.776 07:15:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:18.776 07:15:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.776 07:15:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:18.776 07:15:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.776 07:15:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:18.776 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:18.776 07:15:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.776 07:15:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:18.776 07:15:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:18.776 07:15:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:18.776 07:15:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:18.776 07:15:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:18.776 07:15:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:18.776 07:15:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:18.776 07:15:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:18.777 07:15:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:18.777 07:15:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:18.777 07:15:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:18.777 07:15:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:18.777 07:15:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:18.777 07:15:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:18.777 07:15:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:18.777 07:15:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:18.777 07:15:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:18.777 07:15:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:18.777 07:15:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:18.777 07:15:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:18.777 07:15:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:18.777 07:15:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:18.777 07:15:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:18.777 07:15:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:18.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:18.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:17:18.777 00:17:18.777 --- 10.0.0.2 ping statistics --- 00:17:18.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:18.777 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:17:18.777 07:15:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:18.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:18.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:17:18.777 00:17:18.777 --- 10.0.0.1 ping statistics --- 00:17:18.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:18.777 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:17:18.777 07:15:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:18.777 07:15:21 -- nvmf/common.sh@410 -- # return 0 00:17:18.777 07:15:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:18.777 07:15:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:18.777 07:15:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:18.777 07:15:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:18.777 07:15:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:18.777 07:15:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:18.777 07:15:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:18.777 07:15:21 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:18.777 07:15:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:18.777 07:15:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:18.777 07:15:21 -- common/autotest_common.sh@10 -- # set +x 00:17:18.777 07:15:21 -- nvmf/common.sh@469 -- # nvmfpid=1917810 00:17:18.777 07:15:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:18.777 07:15:21 -- nvmf/common.sh@470 -- # waitforlisten 1917810 00:17:18.777 07:15:21 -- common/autotest_common.sh@819 -- # '[' -z 1917810 ']' 00:17:18.777 07:15:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:18.777 07:15:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:18.777 07:15:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:18.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:18.777 07:15:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:18.777 07:15:21 -- common/autotest_common.sh@10 -- # set +x 00:17:18.777 [2024-10-16 07:15:21.366305] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:18.777 [2024-10-16 07:15:21.366396] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:18.777 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.777 [2024-10-16 07:15:21.434614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.777 [2024-10-16 07:15:21.552260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:18.777 [2024-10-16 07:15:21.552402] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.777 [2024-10-16 07:15:21.552420] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.777 [2024-10-16 07:15:21.552432] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.777 [2024-10-16 07:15:21.552458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:19.711 07:15:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:19.711 07:15:22 -- common/autotest_common.sh@852 -- # return 0 00:17:19.711 07:15:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:19.711 07:15:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:19.711 07:15:22 -- common/autotest_common.sh@10 -- # set +x 00:17:19.711 07:15:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:19.711 07:15:22 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:19.711 07:15:22 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:19.711 true 00:17:19.711 07:15:22 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:19.711 07:15:22 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:19.970 07:15:22 -- target/tls.sh@82 -- # version=0 00:17:19.970 07:15:22 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:19.970 07:15:22 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:20.228 07:15:23 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:20.228 07:15:23 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:20.485 07:15:23 -- target/tls.sh@90 -- # version=13 00:17:20.485 07:15:23 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:20.485 07:15:23 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:20.743 07:15:23 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:20.743 07:15:23 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:21.000 07:15:23 -- target/tls.sh@98 -- # version=7 00:17:21.000 07:15:23 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:21.000 07:15:23 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:21.000 07:15:23 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:21.259 07:15:24 -- target/tls.sh@105 -- # ktls=false 00:17:21.259 07:15:24 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:21.259 07:15:24 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:21.517 07:15:24 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:21.517 07:15:24 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:21.775 07:15:24 -- target/tls.sh@113 -- # ktls=true 00:17:21.775 07:15:24 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:21.775 07:15:24 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:22.033 07:15:24 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.033 07:15:24 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:22.291 07:15:25 -- target/tls.sh@121 -- # ktls=false 00:17:22.291 07:15:25 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:22.291 07:15:25 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:22.291 07:15:25 -- target/tls.sh@49 -- # local key hash crc 00:17:22.291 07:15:25 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:22.291 07:15:25 -- target/tls.sh@51 -- # hash=01 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # gzip -1 -c 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # tail -c8 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # head -c 4 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # crc='p$H�' 00:17:22.291 07:15:25 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:22.291 07:15:25 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:22.291 07:15:25 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:22.291 07:15:25 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:22.291 07:15:25 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:22.291 07:15:25 -- target/tls.sh@49 -- # local key hash crc 00:17:22.291 07:15:25 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:22.291 07:15:25 -- target/tls.sh@51 -- # hash=01 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:22.291 07:15:25 -- target/tls.sh@52 -- # gzip -1 -c 00:17:22.549 07:15:25 -- target/tls.sh@52 -- # tail -c8 00:17:22.549 07:15:25 -- target/tls.sh@52 -- # head -c 4 00:17:22.549 07:15:25 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:22.549 07:15:25 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:22.549 07:15:25 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:22.549 07:15:25 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:22.549 07:15:25 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:22.549 07:15:25 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:22.549 07:15:25 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:22.549 07:15:25 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:22.549 07:15:25 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:22.549 07:15:25 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:22.549 07:15:25 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:22.549 07:15:25 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:22.807 07:15:25 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:23.064 07:15:25 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.065 07:15:25 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.065 07:15:25 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:23.323 [2024-10-16 07:15:26.127119] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:23.323 07:15:26 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:23.581 07:15:26 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:23.839 [2024-10-16 07:15:26.680602] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:23.839 [2024-10-16 07:15:26.680871] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:23.839 07:15:26 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:24.096 malloc0 00:17:24.096 07:15:26 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:24.354 07:15:27 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:24.611 07:15:27 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:24.611 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.806 Initializing NVMe Controllers 00:17:36.806 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:36.806 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:36.806 Initialization complete. Launching workers. 00:17:36.806 ======================================================== 00:17:36.806 Latency(us) 00:17:36.806 Device Information : IOPS MiB/s Average min max 00:17:36.806 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7741.79 30.24 8269.12 1358.34 9281.94 00:17:36.806 ======================================================== 00:17:36.806 Total : 7741.79 30.24 8269.12 1358.34 9281.94 00:17:36.806 00:17:36.806 07:15:37 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.806 07:15:37 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:36.806 07:15:37 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:36.806 07:15:37 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:36.806 07:15:37 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:36.806 07:15:37 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:36.806 07:15:37 -- target/tls.sh@28 -- # bdevperf_pid=1919784 00:17:36.806 07:15:37 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:36.806 07:15:37 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:36.806 07:15:37 -- target/tls.sh@31 -- # waitforlisten 1919784 /var/tmp/bdevperf.sock 00:17:36.806 07:15:37 -- common/autotest_common.sh@819 -- # '[' -z 1919784 ']' 00:17:36.806 07:15:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:36.806 07:15:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:36.806 07:15:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:36.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:36.806 07:15:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:36.806 07:15:37 -- common/autotest_common.sh@10 -- # set +x 00:17:36.806 [2024-10-16 07:15:37.587439] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:36.806 [2024-10-16 07:15:37.587537] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919784 ] 00:17:36.806 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.806 [2024-10-16 07:15:37.645063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.806 [2024-10-16 07:15:37.750920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.806 07:15:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:36.806 07:15:38 -- common/autotest_common.sh@852 -- # return 0 00:17:36.806 07:15:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:36.806 [2024-10-16 07:15:38.836946] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:36.806 TLSTESTn1 00:17:36.806 07:15:38 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:36.806 Running I/O for 10 seconds... 00:17:46.846 00:17:46.846 Latency(us) 00:17:46.846 [2024-10-16T05:15:49.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.846 [2024-10-16T05:15:49.786Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:46.846 Verification LBA range: start 0x0 length 0x2000 00:17:46.846 TLSTESTn1 : 10.02 4693.39 18.33 0.00 0.00 27238.08 4854.52 43884.85 00:17:46.846 [2024-10-16T05:15:49.786Z] =================================================================================================================== 00:17:46.846 [2024-10-16T05:15:49.786Z] Total : 4693.39 18.33 0.00 0.00 27238.08 4854.52 43884.85 00:17:46.846 0 00:17:46.846 07:15:49 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:46.846 07:15:49 -- target/tls.sh@45 -- # killprocess 1919784 00:17:46.846 07:15:49 -- common/autotest_common.sh@926 -- # '[' -z 1919784 ']' 00:17:46.846 07:15:49 -- common/autotest_common.sh@930 -- # kill -0 1919784 00:17:46.846 07:15:49 -- common/autotest_common.sh@931 -- # uname 00:17:46.846 07:15:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:46.846 07:15:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1919784 00:17:46.846 07:15:49 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:46.846 07:15:49 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:46.846 07:15:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1919784' 00:17:46.846 killing process with pid 1919784 00:17:46.846 07:15:49 -- common/autotest_common.sh@945 -- # kill 1919784 00:17:46.846 Received shutdown signal, test time was about 10.000000 seconds 00:17:46.846 00:17:46.846 Latency(us) 00:17:46.846 [2024-10-16T05:15:49.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.846 [2024-10-16T05:15:49.786Z] =================================================================================================================== 00:17:46.846 [2024-10-16T05:15:49.786Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:46.846 07:15:49 -- common/autotest_common.sh@950 -- # wait 1919784 00:17:46.846 07:15:49 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:46.846 07:15:49 -- common/autotest_common.sh@640 -- # local es=0 00:17:46.846 07:15:49 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:46.846 07:15:49 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:46.846 07:15:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:46.846 07:15:49 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:46.846 07:15:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:46.846 07:15:49 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:46.846 07:15:49 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:46.846 07:15:49 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:46.846 07:15:49 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:46.846 07:15:49 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:46.846 07:15:49 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.846 07:15:49 -- target/tls.sh@28 -- # bdevperf_pid=1921154 00:17:46.846 07:15:49 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.846 07:15:49 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.846 07:15:49 -- target/tls.sh@31 -- # waitforlisten 1921154 /var/tmp/bdevperf.sock 00:17:46.846 07:15:49 -- common/autotest_common.sh@819 -- # '[' -z 1921154 ']' 00:17:46.846 07:15:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.846 07:15:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:46.846 07:15:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.846 07:15:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:46.846 07:15:49 -- common/autotest_common.sh@10 -- # set +x 00:17:46.846 [2024-10-16 07:15:49.460647] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:46.846 [2024-10-16 07:15:49.460753] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921154 ] 00:17:46.846 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.846 [2024-10-16 07:15:49.518465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.846 [2024-10-16 07:15:49.627265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.803 07:15:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:47.803 07:15:50 -- common/autotest_common.sh@852 -- # return 0 00:17:47.803 07:15:50 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:48.060 [2024-10-16 07:15:50.749123] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:48.060 [2024-10-16 07:15:50.760304] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:48.060 [2024-10-16 07:15:50.761047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d6c1f0 (107): Transport endpoint is not connected 00:17:48.060 [2024-10-16 07:15:50.762030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d6c1f0 (9): Bad file descriptor 00:17:48.060 [2024-10-16 07:15:50.763028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:48.060 [2024-10-16 07:15:50.763046] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:48.060 [2024-10-16 07:15:50.763059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:48.060 request: 00:17:48.060 { 00:17:48.060 "name": "TLSTEST", 00:17:48.060 "trtype": "tcp", 00:17:48.060 "traddr": "10.0.0.2", 00:17:48.060 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:48.060 "adrfam": "ipv4", 00:17:48.060 "trsvcid": "4420", 00:17:48.060 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.060 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:48.060 "method": "bdev_nvme_attach_controller", 00:17:48.060 "req_id": 1 00:17:48.060 } 00:17:48.060 Got JSON-RPC error response 00:17:48.060 response: 00:17:48.060 { 00:17:48.060 "code": -32602, 00:17:48.060 "message": "Invalid parameters" 00:17:48.060 } 00:17:48.060 07:15:50 -- target/tls.sh@36 -- # killprocess 1921154 00:17:48.060 07:15:50 -- common/autotest_common.sh@926 -- # '[' -z 1921154 ']' 00:17:48.060 07:15:50 -- common/autotest_common.sh@930 -- # kill -0 1921154 00:17:48.060 07:15:50 -- common/autotest_common.sh@931 -- # uname 00:17:48.060 07:15:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:48.060 07:15:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1921154 00:17:48.060 07:15:50 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:48.060 07:15:50 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:48.060 07:15:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1921154' 00:17:48.060 killing process with pid 1921154 00:17:48.061 07:15:50 -- common/autotest_common.sh@945 -- # kill 1921154 00:17:48.061 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.061 00:17:48.061 Latency(us) 00:17:48.061 [2024-10-16T05:15:51.001Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.061 [2024-10-16T05:15:51.001Z] =================================================================================================================== 00:17:48.061 [2024-10-16T05:15:51.001Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:48.061 07:15:50 -- common/autotest_common.sh@950 -- # wait 1921154 00:17:48.318 07:15:51 -- target/tls.sh@37 -- # return 1 00:17:48.318 07:15:51 -- common/autotest_common.sh@643 -- # es=1 00:17:48.318 07:15:51 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:48.318 07:15:51 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:48.318 07:15:51 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:48.318 07:15:51 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.318 07:15:51 -- common/autotest_common.sh@640 -- # local es=0 00:17:48.318 07:15:51 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.318 07:15:51 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:48.318 07:15:51 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:48.318 07:15:51 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:48.318 07:15:51 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:48.318 07:15:51 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:48.318 07:15:51 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:48.318 07:15:51 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:48.318 07:15:51 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:48.318 07:15:51 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:48.318 07:15:51 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:48.318 07:15:51 -- target/tls.sh@28 -- # bdevperf_pid=1921428 00:17:48.318 07:15:51 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:48.318 07:15:51 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:48.318 07:15:51 -- target/tls.sh@31 -- # waitforlisten 1921428 /var/tmp/bdevperf.sock 00:17:48.318 07:15:51 -- common/autotest_common.sh@819 -- # '[' -z 1921428 ']' 00:17:48.318 07:15:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.318 07:15:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:48.318 07:15:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.318 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.318 07:15:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:48.318 07:15:51 -- common/autotest_common.sh@10 -- # set +x 00:17:48.318 [2024-10-16 07:15:51.124449] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:48.318 [2024-10-16 07:15:51.124527] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921428 ] 00:17:48.318 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.318 [2024-10-16 07:15:51.181273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.576 [2024-10-16 07:15:51.284541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:49.509 07:15:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:49.509 07:15:52 -- common/autotest_common.sh@852 -- # return 0 00:17:49.509 07:15:52 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.509 [2024-10-16 07:15:52.365412] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:49.509 [2024-10-16 07:15:52.374388] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:49.509 [2024-10-16 07:15:52.374425] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:49.509 [2024-10-16 07:15:52.374465] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:49.509 [2024-10-16 07:15:52.375168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x59a1f0 (107): Transport endpoint is not connected 00:17:49.509 [2024-10-16 07:15:52.376157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x59a1f0 (9): Bad file descriptor 00:17:49.509 [2024-10-16 07:15:52.377157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:49.509 [2024-10-16 07:15:52.377178] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:49.509 [2024-10-16 07:15:52.377192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:49.509 request: 00:17:49.509 { 00:17:49.509 "name": "TLSTEST", 00:17:49.509 "trtype": "tcp", 00:17:49.509 "traddr": "10.0.0.2", 00:17:49.509 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:49.509 "adrfam": "ipv4", 00:17:49.509 "trsvcid": "4420", 00:17:49.509 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:49.509 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:49.509 "method": "bdev_nvme_attach_controller", 00:17:49.509 "req_id": 1 00:17:49.509 } 00:17:49.509 Got JSON-RPC error response 00:17:49.509 response: 00:17:49.509 { 00:17:49.509 "code": -32602, 00:17:49.509 "message": "Invalid parameters" 00:17:49.509 } 00:17:49.509 07:15:52 -- target/tls.sh@36 -- # killprocess 1921428 00:17:49.509 07:15:52 -- common/autotest_common.sh@926 -- # '[' -z 1921428 ']' 00:17:49.509 07:15:52 -- common/autotest_common.sh@930 -- # kill -0 1921428 00:17:49.509 07:15:52 -- common/autotest_common.sh@931 -- # uname 00:17:49.509 07:15:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:49.509 07:15:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1921428 00:17:49.509 07:15:52 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:49.509 07:15:52 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:49.509 07:15:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1921428' 00:17:49.509 killing process with pid 1921428 00:17:49.509 07:15:52 -- common/autotest_common.sh@945 -- # kill 1921428 00:17:49.509 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.509 00:17:49.509 Latency(us) 00:17:49.509 [2024-10-16T05:15:52.449Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.509 [2024-10-16T05:15:52.449Z] =================================================================================================================== 00:17:49.509 [2024-10-16T05:15:52.449Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:49.509 07:15:52 -- common/autotest_common.sh@950 -- # wait 1921428 00:17:49.767 07:15:52 -- target/tls.sh@37 -- # return 1 00:17:49.767 07:15:52 -- common/autotest_common.sh@643 -- # es=1 00:17:49.767 07:15:52 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:49.767 07:15:52 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:49.767 07:15:52 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:49.767 07:15:52 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.767 07:15:52 -- common/autotest_common.sh@640 -- # local es=0 00:17:49.767 07:15:52 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.767 07:15:52 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:49.767 07:15:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:49.767 07:15:52 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:49.767 07:15:52 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:49.767 07:15:52 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:49.767 07:15:52 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:49.767 07:15:52 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:49.767 07:15:52 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:49.767 07:15:52 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:49.767 07:15:52 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:49.767 07:15:52 -- target/tls.sh@28 -- # bdevperf_pid=1921586 00:17:49.767 07:15:52 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:49.767 07:15:52 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:49.767 07:15:52 -- target/tls.sh@31 -- # waitforlisten 1921586 /var/tmp/bdevperf.sock 00:17:49.767 07:15:52 -- common/autotest_common.sh@819 -- # '[' -z 1921586 ']' 00:17:49.767 07:15:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.767 07:15:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:49.767 07:15:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.767 07:15:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:49.767 07:15:52 -- common/autotest_common.sh@10 -- # set +x 00:17:50.025 [2024-10-16 07:15:52.734823] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:50.025 [2024-10-16 07:15:52.734916] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921586 ] 00:17:50.025 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.025 [2024-10-16 07:15:52.792654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.025 [2024-10-16 07:15:52.898803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.958 07:15:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:50.958 07:15:53 -- common/autotest_common.sh@852 -- # return 0 00:17:50.958 07:15:53 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.215 [2024-10-16 07:15:54.045515] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.215 [2024-10-16 07:15:54.050751] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:51.215 [2024-10-16 07:15:54.050785] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:51.215 [2024-10-16 07:15:54.050827] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:51.215 [2024-10-16 07:15:54.051320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17e11f0 (107): Transport endpoint is not connected 00:17:51.215 [2024-10-16 07:15:54.052307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17e11f0 (9): Bad file descriptor 00:17:51.215 [2024-10-16 07:15:54.053306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:51.215 [2024-10-16 07:15:54.053326] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:51.215 [2024-10-16 07:15:54.053340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:51.215 request: 00:17:51.215 { 00:17:51.215 "name": "TLSTEST", 00:17:51.215 "trtype": "tcp", 00:17:51.215 "traddr": "10.0.0.2", 00:17:51.215 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.215 "adrfam": "ipv4", 00:17:51.215 "trsvcid": "4420", 00:17:51.215 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:51.215 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:51.215 "method": "bdev_nvme_attach_controller", 00:17:51.215 "req_id": 1 00:17:51.215 } 00:17:51.215 Got JSON-RPC error response 00:17:51.215 response: 00:17:51.215 { 00:17:51.215 "code": -32602, 00:17:51.215 "message": "Invalid parameters" 00:17:51.215 } 00:17:51.215 07:15:54 -- target/tls.sh@36 -- # killprocess 1921586 00:17:51.215 07:15:54 -- common/autotest_common.sh@926 -- # '[' -z 1921586 ']' 00:17:51.215 07:15:54 -- common/autotest_common.sh@930 -- # kill -0 1921586 00:17:51.215 07:15:54 -- common/autotest_common.sh@931 -- # uname 00:17:51.215 07:15:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:51.215 07:15:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1921586 00:17:51.215 07:15:54 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:51.215 07:15:54 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:51.215 07:15:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1921586' 00:17:51.215 killing process with pid 1921586 00:17:51.215 07:15:54 -- common/autotest_common.sh@945 -- # kill 1921586 00:17:51.215 Received shutdown signal, test time was about 10.000000 seconds 00:17:51.215 00:17:51.215 Latency(us) 00:17:51.215 [2024-10-16T05:15:54.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.215 [2024-10-16T05:15:54.155Z] =================================================================================================================== 00:17:51.215 [2024-10-16T05:15:54.155Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:51.215 07:15:54 -- common/autotest_common.sh@950 -- # wait 1921586 00:17:51.472 07:15:54 -- target/tls.sh@37 -- # return 1 00:17:51.472 07:15:54 -- common/autotest_common.sh@643 -- # es=1 00:17:51.472 07:15:54 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:51.472 07:15:54 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:51.472 07:15:54 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:51.472 07:15:54 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:51.472 07:15:54 -- common/autotest_common.sh@640 -- # local es=0 00:17:51.472 07:15:54 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:51.472 07:15:54 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:51.472 07:15:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:51.472 07:15:54 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:51.472 07:15:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:51.472 07:15:54 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:51.472 07:15:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:51.472 07:15:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:51.472 07:15:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:51.472 07:15:54 -- target/tls.sh@23 -- # psk= 00:17:51.472 07:15:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.472 07:15:54 -- target/tls.sh@28 -- # bdevperf_pid=1921857 00:17:51.472 07:15:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:51.472 07:15:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:51.472 07:15:54 -- target/tls.sh@31 -- # waitforlisten 1921857 /var/tmp/bdevperf.sock 00:17:51.472 07:15:54 -- common/autotest_common.sh@819 -- # '[' -z 1921857 ']' 00:17:51.472 07:15:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.472 07:15:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:51.472 07:15:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.472 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.472 07:15:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:51.472 07:15:54 -- common/autotest_common.sh@10 -- # set +x 00:17:51.472 [2024-10-16 07:15:54.384981] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:51.472 [2024-10-16 07:15:54.385097] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1921857 ] 00:17:51.472 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.730 [2024-10-16 07:15:54.442598] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.730 [2024-10-16 07:15:54.549686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.663 07:15:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:52.663 07:15:55 -- common/autotest_common.sh@852 -- # return 0 00:17:52.663 07:15:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:52.922 [2024-10-16 07:15:55.642968] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:52.922 [2024-10-16 07:15:55.644928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bd7050 (9): Bad file descriptor 00:17:52.922 [2024-10-16 07:15:55.645925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:52.922 [2024-10-16 07:15:55.645946] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:52.922 [2024-10-16 07:15:55.645960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:52.922 request: 00:17:52.922 { 00:17:52.922 "name": "TLSTEST", 00:17:52.922 "trtype": "tcp", 00:17:52.922 "traddr": "10.0.0.2", 00:17:52.922 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:52.922 "adrfam": "ipv4", 00:17:52.922 "trsvcid": "4420", 00:17:52.922 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:52.922 "method": "bdev_nvme_attach_controller", 00:17:52.922 "req_id": 1 00:17:52.922 } 00:17:52.922 Got JSON-RPC error response 00:17:52.922 response: 00:17:52.922 { 00:17:52.922 "code": -32602, 00:17:52.922 "message": "Invalid parameters" 00:17:52.922 } 00:17:52.922 07:15:55 -- target/tls.sh@36 -- # killprocess 1921857 00:17:52.922 07:15:55 -- common/autotest_common.sh@926 -- # '[' -z 1921857 ']' 00:17:52.922 07:15:55 -- common/autotest_common.sh@930 -- # kill -0 1921857 00:17:52.922 07:15:55 -- common/autotest_common.sh@931 -- # uname 00:17:52.922 07:15:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:52.922 07:15:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1921857 00:17:52.922 07:15:55 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:52.922 07:15:55 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:52.922 07:15:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1921857' 00:17:52.922 killing process with pid 1921857 00:17:52.922 07:15:55 -- common/autotest_common.sh@945 -- # kill 1921857 00:17:52.922 Received shutdown signal, test time was about 10.000000 seconds 00:17:52.922 00:17:52.922 Latency(us) 00:17:52.922 [2024-10-16T05:15:55.862Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.922 [2024-10-16T05:15:55.862Z] =================================================================================================================== 00:17:52.922 [2024-10-16T05:15:55.862Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:52.922 07:15:55 -- common/autotest_common.sh@950 -- # wait 1921857 00:17:53.180 07:15:55 -- target/tls.sh@37 -- # return 1 00:17:53.180 07:15:55 -- common/autotest_common.sh@643 -- # es=1 00:17:53.180 07:15:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:53.180 07:15:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:53.180 07:15:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:53.180 07:15:55 -- target/tls.sh@167 -- # killprocess 1917810 00:17:53.180 07:15:55 -- common/autotest_common.sh@926 -- # '[' -z 1917810 ']' 00:17:53.180 07:15:55 -- common/autotest_common.sh@930 -- # kill -0 1917810 00:17:53.180 07:15:55 -- common/autotest_common.sh@931 -- # uname 00:17:53.180 07:15:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:53.180 07:15:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1917810 00:17:53.180 07:15:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:53.180 07:15:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:53.180 07:15:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1917810' 00:17:53.180 killing process with pid 1917810 00:17:53.180 07:15:56 -- common/autotest_common.sh@945 -- # kill 1917810 00:17:53.180 07:15:56 -- common/autotest_common.sh@950 -- # wait 1917810 00:17:53.438 07:15:56 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:53.438 07:15:56 -- target/tls.sh@49 -- # local key hash crc 00:17:53.438 07:15:56 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:53.438 07:15:56 -- target/tls.sh@51 -- # hash=02 00:17:53.438 07:15:56 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:53.438 07:15:56 -- target/tls.sh@52 -- # gzip -1 -c 00:17:53.438 07:15:56 -- target/tls.sh@52 -- # tail -c8 00:17:53.438 07:15:56 -- target/tls.sh@52 -- # head -c 4 00:17:53.438 07:15:56 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:53.438 07:15:56 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:53.438 07:15:56 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:53.438 07:15:56 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:53.438 07:15:56 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:53.438 07:15:56 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:53.438 07:15:56 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:53.438 07:15:56 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:53.438 07:15:56 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:53.438 07:15:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:53.438 07:15:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:53.438 07:15:56 -- common/autotest_common.sh@10 -- # set +x 00:17:53.438 07:15:56 -- nvmf/common.sh@469 -- # nvmfpid=1922038 00:17:53.438 07:15:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:53.438 07:15:56 -- nvmf/common.sh@470 -- # waitforlisten 1922038 00:17:53.438 07:15:56 -- common/autotest_common.sh@819 -- # '[' -z 1922038 ']' 00:17:53.438 07:15:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:53.438 07:15:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:53.438 07:15:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:53.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:53.438 07:15:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:53.438 07:15:56 -- common/autotest_common.sh@10 -- # set +x 00:17:53.438 [2024-10-16 07:15:56.370065] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:53.438 [2024-10-16 07:15:56.370162] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:53.697 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.697 [2024-10-16 07:15:56.441838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:53.697 [2024-10-16 07:15:56.557163] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:53.697 [2024-10-16 07:15:56.557331] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:53.697 [2024-10-16 07:15:56.557351] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:53.697 [2024-10-16 07:15:56.557366] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:53.697 [2024-10-16 07:15:56.557399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:54.630 07:15:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:54.630 07:15:57 -- common/autotest_common.sh@852 -- # return 0 00:17:54.630 07:15:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:54.630 07:15:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:54.630 07:15:57 -- common/autotest_common.sh@10 -- # set +x 00:17:54.630 07:15:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:54.630 07:15:57 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.630 07:15:57 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.630 07:15:57 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:54.888 [2024-10-16 07:15:57.620160] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:54.888 07:15:57 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:55.147 07:15:57 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:55.404 [2024-10-16 07:15:58.105467] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:55.404 [2024-10-16 07:15:58.105737] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:55.404 07:15:58 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:55.662 malloc0 00:17:55.662 07:15:58 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:55.920 07:15:58 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.178 07:15:58 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.178 07:15:58 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:56.178 07:15:58 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:56.178 07:15:58 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:56.178 07:15:58 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:56.178 07:15:58 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:56.178 07:15:58 -- target/tls.sh@28 -- # bdevperf_pid=1922451 00:17:56.178 07:15:58 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:56.178 07:15:58 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:56.178 07:15:58 -- target/tls.sh@31 -- # waitforlisten 1922451 /var/tmp/bdevperf.sock 00:17:56.178 07:15:58 -- common/autotest_common.sh@819 -- # '[' -z 1922451 ']' 00:17:56.178 07:15:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:56.178 07:15:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:56.178 07:15:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:56.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:56.178 07:15:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:56.178 07:15:58 -- common/autotest_common.sh@10 -- # set +x 00:17:56.178 [2024-10-16 07:15:58.917300] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:56.178 [2024-10-16 07:15:58.917379] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922451 ] 00:17:56.178 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.178 [2024-10-16 07:15:58.976254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.178 [2024-10-16 07:15:59.079530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:57.113 07:15:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:57.113 07:15:59 -- common/autotest_common.sh@852 -- # return 0 00:17:57.113 07:15:59 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.371 [2024-10-16 07:16:00.121634] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:57.371 TLSTESTn1 00:17:57.371 07:16:00 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:57.629 Running I/O for 10 seconds... 00:18:07.597 00:18:07.597 Latency(us) 00:18:07.597 [2024-10-16T05:16:10.537Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.597 [2024-10-16T05:16:10.537Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:07.597 Verification LBA range: start 0x0 length 0x2000 00:18:07.597 TLSTESTn1 : 10.02 4536.47 17.72 0.00 0.00 28177.65 6262.33 45632.47 00:18:07.597 [2024-10-16T05:16:10.537Z] =================================================================================================================== 00:18:07.597 [2024-10-16T05:16:10.537Z] Total : 4536.47 17.72 0.00 0.00 28177.65 6262.33 45632.47 00:18:07.597 0 00:18:07.597 07:16:10 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:07.597 07:16:10 -- target/tls.sh@45 -- # killprocess 1922451 00:18:07.597 07:16:10 -- common/autotest_common.sh@926 -- # '[' -z 1922451 ']' 00:18:07.597 07:16:10 -- common/autotest_common.sh@930 -- # kill -0 1922451 00:18:07.597 07:16:10 -- common/autotest_common.sh@931 -- # uname 00:18:07.597 07:16:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:07.597 07:16:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1922451 00:18:07.597 07:16:10 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:07.597 07:16:10 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:07.597 07:16:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1922451' 00:18:07.597 killing process with pid 1922451 00:18:07.597 07:16:10 -- common/autotest_common.sh@945 -- # kill 1922451 00:18:07.597 Received shutdown signal, test time was about 10.000000 seconds 00:18:07.597 00:18:07.597 Latency(us) 00:18:07.597 [2024-10-16T05:16:10.537Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.597 [2024-10-16T05:16:10.537Z] =================================================================================================================== 00:18:07.597 [2024-10-16T05:16:10.537Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:07.597 07:16:10 -- common/autotest_common.sh@950 -- # wait 1922451 00:18:07.855 07:16:10 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.855 07:16:10 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.855 07:16:10 -- common/autotest_common.sh@640 -- # local es=0 00:18:07.855 07:16:10 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.855 07:16:10 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:18:07.855 07:16:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:07.855 07:16:10 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:18:07.855 07:16:10 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:07.855 07:16:10 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.855 07:16:10 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:07.855 07:16:10 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:07.855 07:16:10 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:07.855 07:16:10 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:07.855 07:16:10 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:07.855 07:16:10 -- target/tls.sh@28 -- # bdevperf_pid=1923824 00:18:07.855 07:16:10 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:07.855 07:16:10 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:07.855 07:16:10 -- target/tls.sh@31 -- # waitforlisten 1923824 /var/tmp/bdevperf.sock 00:18:07.855 07:16:10 -- common/autotest_common.sh@819 -- # '[' -z 1923824 ']' 00:18:07.855 07:16:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:07.855 07:16:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:07.855 07:16:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:07.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:07.855 07:16:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:07.855 07:16:10 -- common/autotest_common.sh@10 -- # set +x 00:18:07.855 [2024-10-16 07:16:10.739955] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:07.855 [2024-10-16 07:16:10.740038] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1923824 ] 00:18:07.855 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.855 [2024-10-16 07:16:10.796155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.113 [2024-10-16 07:16:10.896766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:09.046 07:16:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:09.046 07:16:11 -- common/autotest_common.sh@852 -- # return 0 00:18:09.047 07:16:11 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.304 [2024-10-16 07:16:12.008380] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:09.304 [2024-10-16 07:16:12.008437] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:09.304 request: 00:18:09.304 { 00:18:09.304 "name": "TLSTEST", 00:18:09.304 "trtype": "tcp", 00:18:09.304 "traddr": "10.0.0.2", 00:18:09.304 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:09.304 "adrfam": "ipv4", 00:18:09.304 "trsvcid": "4420", 00:18:09.304 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:09.304 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:09.304 "method": "bdev_nvme_attach_controller", 00:18:09.304 "req_id": 1 00:18:09.304 } 00:18:09.304 Got JSON-RPC error response 00:18:09.304 response: 00:18:09.304 { 00:18:09.304 "code": -22, 00:18:09.304 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:09.304 } 00:18:09.304 07:16:12 -- target/tls.sh@36 -- # killprocess 1923824 00:18:09.304 07:16:12 -- common/autotest_common.sh@926 -- # '[' -z 1923824 ']' 00:18:09.304 07:16:12 -- common/autotest_common.sh@930 -- # kill -0 1923824 00:18:09.304 07:16:12 -- common/autotest_common.sh@931 -- # uname 00:18:09.304 07:16:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:09.304 07:16:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1923824 00:18:09.304 07:16:12 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:09.304 07:16:12 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:09.304 07:16:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1923824' 00:18:09.304 killing process with pid 1923824 00:18:09.304 07:16:12 -- common/autotest_common.sh@945 -- # kill 1923824 00:18:09.304 Received shutdown signal, test time was about 10.000000 seconds 00:18:09.304 00:18:09.304 Latency(us) 00:18:09.304 [2024-10-16T05:16:12.244Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:09.304 [2024-10-16T05:16:12.244Z] =================================================================================================================== 00:18:09.304 [2024-10-16T05:16:12.244Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:09.304 07:16:12 -- common/autotest_common.sh@950 -- # wait 1923824 00:18:09.561 07:16:12 -- target/tls.sh@37 -- # return 1 00:18:09.561 07:16:12 -- common/autotest_common.sh@643 -- # es=1 00:18:09.561 07:16:12 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:09.561 07:16:12 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:09.561 07:16:12 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:09.561 07:16:12 -- target/tls.sh@183 -- # killprocess 1922038 00:18:09.561 07:16:12 -- common/autotest_common.sh@926 -- # '[' -z 1922038 ']' 00:18:09.561 07:16:12 -- common/autotest_common.sh@930 -- # kill -0 1922038 00:18:09.561 07:16:12 -- common/autotest_common.sh@931 -- # uname 00:18:09.561 07:16:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:09.561 07:16:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1922038 00:18:09.561 07:16:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:09.561 07:16:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:09.561 07:16:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1922038' 00:18:09.561 killing process with pid 1922038 00:18:09.561 07:16:12 -- common/autotest_common.sh@945 -- # kill 1922038 00:18:09.561 07:16:12 -- common/autotest_common.sh@950 -- # wait 1922038 00:18:09.820 07:16:12 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:09.820 07:16:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:09.820 07:16:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:09.820 07:16:12 -- common/autotest_common.sh@10 -- # set +x 00:18:09.820 07:16:12 -- nvmf/common.sh@469 -- # nvmfpid=1924100 00:18:09.820 07:16:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:09.820 07:16:12 -- nvmf/common.sh@470 -- # waitforlisten 1924100 00:18:09.820 07:16:12 -- common/autotest_common.sh@819 -- # '[' -z 1924100 ']' 00:18:09.820 07:16:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:09.820 07:16:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:09.820 07:16:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:09.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:09.820 07:16:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:09.820 07:16:12 -- common/autotest_common.sh@10 -- # set +x 00:18:09.820 [2024-10-16 07:16:12.697388] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:09.820 [2024-10-16 07:16:12.697455] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:09.820 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.078 [2024-10-16 07:16:12.764710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.078 [2024-10-16 07:16:12.878417] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:10.078 [2024-10-16 07:16:12.878578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:10.078 [2024-10-16 07:16:12.878598] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:10.078 [2024-10-16 07:16:12.878614] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:10.078 [2024-10-16 07:16:12.878656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:11.011 07:16:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:11.011 07:16:13 -- common/autotest_common.sh@852 -- # return 0 00:18:11.011 07:16:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:11.011 07:16:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:11.011 07:16:13 -- common/autotest_common.sh@10 -- # set +x 00:18:11.011 07:16:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:11.011 07:16:13 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.011 07:16:13 -- common/autotest_common.sh@640 -- # local es=0 00:18:11.011 07:16:13 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.011 07:16:13 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:18:11.011 07:16:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:11.011 07:16:13 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:18:11.011 07:16:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:11.011 07:16:13 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.011 07:16:13 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.011 07:16:13 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:11.269 [2024-10-16 07:16:13.964932] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:11.269 07:16:13 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:11.526 07:16:14 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:11.526 [2024-10-16 07:16:14.450271] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:11.526 [2024-10-16 07:16:14.450522] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:11.526 07:16:14 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:11.784 malloc0 00:18:12.042 07:16:14 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:12.301 07:16:14 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.301 [2024-10-16 07:16:15.217117] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:12.301 [2024-10-16 07:16:15.217160] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:12.301 [2024-10-16 07:16:15.217191] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:12.301 request: 00:18:12.301 { 00:18:12.301 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.301 "host": "nqn.2016-06.io.spdk:host1", 00:18:12.301 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:12.301 "method": "nvmf_subsystem_add_host", 00:18:12.301 "req_id": 1 00:18:12.301 } 00:18:12.301 Got JSON-RPC error response 00:18:12.301 response: 00:18:12.301 { 00:18:12.301 "code": -32603, 00:18:12.301 "message": "Internal error" 00:18:12.301 } 00:18:12.301 07:16:15 -- common/autotest_common.sh@643 -- # es=1 00:18:12.301 07:16:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:12.301 07:16:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:12.301 07:16:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:12.301 07:16:15 -- target/tls.sh@189 -- # killprocess 1924100 00:18:12.301 07:16:15 -- common/autotest_common.sh@926 -- # '[' -z 1924100 ']' 00:18:12.301 07:16:15 -- common/autotest_common.sh@930 -- # kill -0 1924100 00:18:12.301 07:16:15 -- common/autotest_common.sh@931 -- # uname 00:18:12.301 07:16:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:12.559 07:16:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1924100 00:18:12.559 07:16:15 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:12.559 07:16:15 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:12.559 07:16:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1924100' 00:18:12.559 killing process with pid 1924100 00:18:12.559 07:16:15 -- common/autotest_common.sh@945 -- # kill 1924100 00:18:12.559 07:16:15 -- common/autotest_common.sh@950 -- # wait 1924100 00:18:12.819 07:16:15 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.819 07:16:15 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:12.819 07:16:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:12.819 07:16:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:12.819 07:16:15 -- common/autotest_common.sh@10 -- # set +x 00:18:12.819 07:16:15 -- nvmf/common.sh@469 -- # nvmfpid=1924414 00:18:12.819 07:16:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:12.819 07:16:15 -- nvmf/common.sh@470 -- # waitforlisten 1924414 00:18:12.819 07:16:15 -- common/autotest_common.sh@819 -- # '[' -z 1924414 ']' 00:18:12.819 07:16:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:12.819 07:16:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:12.819 07:16:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:12.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:12.819 07:16:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:12.819 07:16:15 -- common/autotest_common.sh@10 -- # set +x 00:18:12.819 [2024-10-16 07:16:15.629195] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:12.819 [2024-10-16 07:16:15.629277] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:12.819 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.819 [2024-10-16 07:16:15.704947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:13.078 [2024-10-16 07:16:15.826650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:13.078 [2024-10-16 07:16:15.826834] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:13.078 [2024-10-16 07:16:15.826853] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:13.078 [2024-10-16 07:16:15.826865] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:13.078 [2024-10-16 07:16:15.826895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:14.011 07:16:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:14.011 07:16:16 -- common/autotest_common.sh@852 -- # return 0 00:18:14.011 07:16:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:14.011 07:16:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:14.011 07:16:16 -- common/autotest_common.sh@10 -- # set +x 00:18:14.011 07:16:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:14.011 07:16:16 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.011 07:16:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.011 07:16:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:14.011 [2024-10-16 07:16:16.915186] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:14.011 07:16:16 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:14.269 07:16:17 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:14.527 [2024-10-16 07:16:17.420536] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:14.527 [2024-10-16 07:16:17.420825] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:14.527 07:16:17 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:15.094 malloc0 00:18:15.094 07:16:17 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:15.352 07:16:18 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.352 07:16:18 -- target/tls.sh@197 -- # bdevperf_pid=1924842 00:18:15.352 07:16:18 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:15.610 07:16:18 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:15.610 07:16:18 -- target/tls.sh@200 -- # waitforlisten 1924842 /var/tmp/bdevperf.sock 00:18:15.610 07:16:18 -- common/autotest_common.sh@819 -- # '[' -z 1924842 ']' 00:18:15.610 07:16:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:15.610 07:16:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:15.610 07:16:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:15.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:15.610 07:16:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:15.610 07:16:18 -- common/autotest_common.sh@10 -- # set +x 00:18:15.610 [2024-10-16 07:16:18.328895] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:15.610 [2024-10-16 07:16:18.328966] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1924842 ] 00:18:15.610 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.610 [2024-10-16 07:16:18.386214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.610 [2024-10-16 07:16:18.493243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:16.543 07:16:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:16.543 07:16:19 -- common/autotest_common.sh@852 -- # return 0 00:18:16.543 07:16:19 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.803 [2024-10-16 07:16:19.570498] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:16.803 TLSTESTn1 00:18:16.803 07:16:19 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:17.369 07:16:20 -- target/tls.sh@205 -- # tgtconf='{ 00:18:17.369 "subsystems": [ 00:18:17.369 { 00:18:17.369 "subsystem": "iobuf", 00:18:17.369 "config": [ 00:18:17.369 { 00:18:17.369 "method": "iobuf_set_options", 00:18:17.369 "params": { 00:18:17.369 "small_pool_count": 8192, 00:18:17.369 "large_pool_count": 1024, 00:18:17.369 "small_bufsize": 8192, 00:18:17.369 "large_bufsize": 135168 00:18:17.369 } 00:18:17.369 } 00:18:17.369 ] 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "subsystem": "sock", 00:18:17.369 "config": [ 00:18:17.369 { 00:18:17.369 "method": "sock_impl_set_options", 00:18:17.369 "params": { 00:18:17.369 "impl_name": "posix", 00:18:17.369 "recv_buf_size": 2097152, 00:18:17.369 "send_buf_size": 2097152, 00:18:17.369 "enable_recv_pipe": true, 00:18:17.369 "enable_quickack": false, 00:18:17.369 "enable_placement_id": 0, 00:18:17.369 "enable_zerocopy_send_server": true, 00:18:17.369 "enable_zerocopy_send_client": false, 00:18:17.369 "zerocopy_threshold": 0, 00:18:17.369 "tls_version": 0, 00:18:17.369 "enable_ktls": false 00:18:17.369 } 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "method": "sock_impl_set_options", 00:18:17.369 "params": { 00:18:17.369 "impl_name": "ssl", 00:18:17.369 "recv_buf_size": 4096, 00:18:17.369 "send_buf_size": 4096, 00:18:17.369 "enable_recv_pipe": true, 00:18:17.369 "enable_quickack": false, 00:18:17.369 "enable_placement_id": 0, 00:18:17.369 "enable_zerocopy_send_server": true, 00:18:17.369 "enable_zerocopy_send_client": false, 00:18:17.369 "zerocopy_threshold": 0, 00:18:17.369 "tls_version": 0, 00:18:17.369 "enable_ktls": false 00:18:17.369 } 00:18:17.369 } 00:18:17.369 ] 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "subsystem": "vmd", 00:18:17.369 "config": [] 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "subsystem": "accel", 00:18:17.369 "config": [ 00:18:17.369 { 00:18:17.369 "method": "accel_set_options", 00:18:17.369 "params": { 00:18:17.369 "small_cache_size": 128, 00:18:17.369 "large_cache_size": 16, 00:18:17.369 "task_count": 2048, 00:18:17.369 "sequence_count": 2048, 00:18:17.369 "buf_count": 2048 00:18:17.369 } 00:18:17.369 } 00:18:17.369 ] 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "subsystem": "bdev", 00:18:17.369 "config": [ 00:18:17.369 { 00:18:17.369 "method": "bdev_set_options", 00:18:17.369 "params": { 00:18:17.369 "bdev_io_pool_size": 65535, 00:18:17.369 "bdev_io_cache_size": 256, 00:18:17.369 "bdev_auto_examine": true, 00:18:17.369 "iobuf_small_cache_size": 128, 00:18:17.369 "iobuf_large_cache_size": 16 00:18:17.369 } 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "method": "bdev_raid_set_options", 00:18:17.369 "params": { 00:18:17.369 "process_window_size_kb": 1024 00:18:17.369 } 00:18:17.369 }, 00:18:17.369 { 00:18:17.369 "method": "bdev_iscsi_set_options", 00:18:17.369 "params": { 00:18:17.369 "timeout_sec": 30 00:18:17.369 } 00:18:17.369 }, 00:18:17.369 { 00:18:17.370 "method": "bdev_nvme_set_options", 00:18:17.370 "params": { 00:18:17.370 "action_on_timeout": "none", 00:18:17.370 "timeout_us": 0, 00:18:17.370 "timeout_admin_us": 0, 00:18:17.370 "keep_alive_timeout_ms": 10000, 00:18:17.370 "transport_retry_count": 4, 00:18:17.370 "arbitration_burst": 0, 00:18:17.370 "low_priority_weight": 0, 00:18:17.370 "medium_priority_weight": 0, 00:18:17.370 "high_priority_weight": 0, 00:18:17.370 "nvme_adminq_poll_period_us": 10000, 00:18:17.370 "nvme_ioq_poll_period_us": 0, 00:18:17.370 "io_queue_requests": 0, 00:18:17.370 "delay_cmd_submit": true, 00:18:17.370 "bdev_retry_count": 3, 00:18:17.370 "transport_ack_timeout": 0, 00:18:17.370 "ctrlr_loss_timeout_sec": 0, 00:18:17.370 "reconnect_delay_sec": 0, 00:18:17.370 "fast_io_fail_timeout_sec": 0, 00:18:17.370 "generate_uuids": false, 00:18:17.370 "transport_tos": 0, 00:18:17.370 "io_path_stat": false, 00:18:17.370 "allow_accel_sequence": false 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "bdev_nvme_set_hotplug", 00:18:17.370 "params": { 00:18:17.370 "period_us": 100000, 00:18:17.370 "enable": false 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "bdev_malloc_create", 00:18:17.370 "params": { 00:18:17.370 "name": "malloc0", 00:18:17.370 "num_blocks": 8192, 00:18:17.370 "block_size": 4096, 00:18:17.370 "physical_block_size": 4096, 00:18:17.370 "uuid": "2507ff91-912e-4887-ae7c-80b6a3a0d8c2", 00:18:17.370 "optimal_io_boundary": 0 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "bdev_wait_for_examine" 00:18:17.370 } 00:18:17.370 ] 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "subsystem": "nbd", 00:18:17.370 "config": [] 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "subsystem": "scheduler", 00:18:17.370 "config": [ 00:18:17.370 { 00:18:17.370 "method": "framework_set_scheduler", 00:18:17.370 "params": { 00:18:17.370 "name": "static" 00:18:17.370 } 00:18:17.370 } 00:18:17.370 ] 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "subsystem": "nvmf", 00:18:17.370 "config": [ 00:18:17.370 { 00:18:17.370 "method": "nvmf_set_config", 00:18:17.370 "params": { 00:18:17.370 "discovery_filter": "match_any", 00:18:17.370 "admin_cmd_passthru": { 00:18:17.370 "identify_ctrlr": false 00:18:17.370 } 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_set_max_subsystems", 00:18:17.370 "params": { 00:18:17.370 "max_subsystems": 1024 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_set_crdt", 00:18:17.370 "params": { 00:18:17.370 "crdt1": 0, 00:18:17.370 "crdt2": 0, 00:18:17.370 "crdt3": 0 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_create_transport", 00:18:17.370 "params": { 00:18:17.370 "trtype": "TCP", 00:18:17.370 "max_queue_depth": 128, 00:18:17.370 "max_io_qpairs_per_ctrlr": 127, 00:18:17.370 "in_capsule_data_size": 4096, 00:18:17.370 "max_io_size": 131072, 00:18:17.370 "io_unit_size": 131072, 00:18:17.370 "max_aq_depth": 128, 00:18:17.370 "num_shared_buffers": 511, 00:18:17.370 "buf_cache_size": 4294967295, 00:18:17.370 "dif_insert_or_strip": false, 00:18:17.370 "zcopy": false, 00:18:17.370 "c2h_success": false, 00:18:17.370 "sock_priority": 0, 00:18:17.370 "abort_timeout_sec": 1 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_create_subsystem", 00:18:17.370 "params": { 00:18:17.370 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.370 "allow_any_host": false, 00:18:17.370 "serial_number": "SPDK00000000000001", 00:18:17.370 "model_number": "SPDK bdev Controller", 00:18:17.370 "max_namespaces": 10, 00:18:17.370 "min_cntlid": 1, 00:18:17.370 "max_cntlid": 65519, 00:18:17.370 "ana_reporting": false 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_subsystem_add_host", 00:18:17.370 "params": { 00:18:17.370 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.370 "host": "nqn.2016-06.io.spdk:host1", 00:18:17.370 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_subsystem_add_ns", 00:18:17.370 "params": { 00:18:17.370 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.370 "namespace": { 00:18:17.370 "nsid": 1, 00:18:17.370 "bdev_name": "malloc0", 00:18:17.370 "nguid": "2507FF91912E4887AE7C80B6A3A0D8C2", 00:18:17.370 "uuid": "2507ff91-912e-4887-ae7c-80b6a3a0d8c2" 00:18:17.370 } 00:18:17.370 } 00:18:17.370 }, 00:18:17.370 { 00:18:17.370 "method": "nvmf_subsystem_add_listener", 00:18:17.370 "params": { 00:18:17.370 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.370 "listen_address": { 00:18:17.370 "trtype": "TCP", 00:18:17.370 "adrfam": "IPv4", 00:18:17.370 "traddr": "10.0.0.2", 00:18:17.370 "trsvcid": "4420" 00:18:17.370 }, 00:18:17.370 "secure_channel": true 00:18:17.370 } 00:18:17.370 } 00:18:17.370 ] 00:18:17.370 } 00:18:17.370 ] 00:18:17.370 }' 00:18:17.370 07:16:20 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:17.629 07:16:20 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:17.629 "subsystems": [ 00:18:17.629 { 00:18:17.629 "subsystem": "iobuf", 00:18:17.629 "config": [ 00:18:17.629 { 00:18:17.629 "method": "iobuf_set_options", 00:18:17.629 "params": { 00:18:17.629 "small_pool_count": 8192, 00:18:17.629 "large_pool_count": 1024, 00:18:17.629 "small_bufsize": 8192, 00:18:17.629 "large_bufsize": 135168 00:18:17.629 } 00:18:17.629 } 00:18:17.629 ] 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "subsystem": "sock", 00:18:17.629 "config": [ 00:18:17.629 { 00:18:17.629 "method": "sock_impl_set_options", 00:18:17.629 "params": { 00:18:17.629 "impl_name": "posix", 00:18:17.629 "recv_buf_size": 2097152, 00:18:17.629 "send_buf_size": 2097152, 00:18:17.629 "enable_recv_pipe": true, 00:18:17.629 "enable_quickack": false, 00:18:17.629 "enable_placement_id": 0, 00:18:17.629 "enable_zerocopy_send_server": true, 00:18:17.629 "enable_zerocopy_send_client": false, 00:18:17.629 "zerocopy_threshold": 0, 00:18:17.629 "tls_version": 0, 00:18:17.629 "enable_ktls": false 00:18:17.629 } 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "method": "sock_impl_set_options", 00:18:17.629 "params": { 00:18:17.629 "impl_name": "ssl", 00:18:17.629 "recv_buf_size": 4096, 00:18:17.629 "send_buf_size": 4096, 00:18:17.629 "enable_recv_pipe": true, 00:18:17.629 "enable_quickack": false, 00:18:17.629 "enable_placement_id": 0, 00:18:17.629 "enable_zerocopy_send_server": true, 00:18:17.629 "enable_zerocopy_send_client": false, 00:18:17.629 "zerocopy_threshold": 0, 00:18:17.629 "tls_version": 0, 00:18:17.629 "enable_ktls": false 00:18:17.629 } 00:18:17.629 } 00:18:17.629 ] 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "subsystem": "vmd", 00:18:17.629 "config": [] 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "subsystem": "accel", 00:18:17.629 "config": [ 00:18:17.629 { 00:18:17.629 "method": "accel_set_options", 00:18:17.629 "params": { 00:18:17.629 "small_cache_size": 128, 00:18:17.629 "large_cache_size": 16, 00:18:17.629 "task_count": 2048, 00:18:17.629 "sequence_count": 2048, 00:18:17.629 "buf_count": 2048 00:18:17.629 } 00:18:17.629 } 00:18:17.629 ] 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "subsystem": "bdev", 00:18:17.629 "config": [ 00:18:17.629 { 00:18:17.629 "method": "bdev_set_options", 00:18:17.629 "params": { 00:18:17.629 "bdev_io_pool_size": 65535, 00:18:17.629 "bdev_io_cache_size": 256, 00:18:17.629 "bdev_auto_examine": true, 00:18:17.629 "iobuf_small_cache_size": 128, 00:18:17.629 "iobuf_large_cache_size": 16 00:18:17.629 } 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "method": "bdev_raid_set_options", 00:18:17.629 "params": { 00:18:17.629 "process_window_size_kb": 1024 00:18:17.629 } 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "method": "bdev_iscsi_set_options", 00:18:17.629 "params": { 00:18:17.629 "timeout_sec": 30 00:18:17.629 } 00:18:17.629 }, 00:18:17.629 { 00:18:17.629 "method": "bdev_nvme_set_options", 00:18:17.629 "params": { 00:18:17.629 "action_on_timeout": "none", 00:18:17.629 "timeout_us": 0, 00:18:17.629 "timeout_admin_us": 0, 00:18:17.629 "keep_alive_timeout_ms": 10000, 00:18:17.629 "transport_retry_count": 4, 00:18:17.629 "arbitration_burst": 0, 00:18:17.629 "low_priority_weight": 0, 00:18:17.629 "medium_priority_weight": 0, 00:18:17.629 "high_priority_weight": 0, 00:18:17.629 "nvme_adminq_poll_period_us": 10000, 00:18:17.630 "nvme_ioq_poll_period_us": 0, 00:18:17.630 "io_queue_requests": 512, 00:18:17.630 "delay_cmd_submit": true, 00:18:17.630 "bdev_retry_count": 3, 00:18:17.630 "transport_ack_timeout": 0, 00:18:17.630 "ctrlr_loss_timeout_sec": 0, 00:18:17.630 "reconnect_delay_sec": 0, 00:18:17.630 "fast_io_fail_timeout_sec": 0, 00:18:17.630 "generate_uuids": false, 00:18:17.630 "transport_tos": 0, 00:18:17.630 "io_path_stat": false, 00:18:17.630 "allow_accel_sequence": false 00:18:17.630 } 00:18:17.630 }, 00:18:17.630 { 00:18:17.630 "method": "bdev_nvme_attach_controller", 00:18:17.630 "params": { 00:18:17.630 "name": "TLSTEST", 00:18:17.630 "trtype": "TCP", 00:18:17.630 "adrfam": "IPv4", 00:18:17.630 "traddr": "10.0.0.2", 00:18:17.630 "trsvcid": "4420", 00:18:17.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.630 "prchk_reftag": false, 00:18:17.630 "prchk_guard": false, 00:18:17.630 "ctrlr_loss_timeout_sec": 0, 00:18:17.630 "reconnect_delay_sec": 0, 00:18:17.630 "fast_io_fail_timeout_sec": 0, 00:18:17.630 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:17.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.630 "hdgst": false, 00:18:17.630 "ddgst": false 00:18:17.630 } 00:18:17.630 }, 00:18:17.630 { 00:18:17.630 "method": "bdev_nvme_set_hotplug", 00:18:17.630 "params": { 00:18:17.630 "period_us": 100000, 00:18:17.630 "enable": false 00:18:17.630 } 00:18:17.630 }, 00:18:17.630 { 00:18:17.630 "method": "bdev_wait_for_examine" 00:18:17.630 } 00:18:17.630 ] 00:18:17.630 }, 00:18:17.630 { 00:18:17.630 "subsystem": "nbd", 00:18:17.630 "config": [] 00:18:17.630 } 00:18:17.630 ] 00:18:17.630 }' 00:18:17.630 07:16:20 -- target/tls.sh@208 -- # killprocess 1924842 00:18:17.630 07:16:20 -- common/autotest_common.sh@926 -- # '[' -z 1924842 ']' 00:18:17.630 07:16:20 -- common/autotest_common.sh@930 -- # kill -0 1924842 00:18:17.630 07:16:20 -- common/autotest_common.sh@931 -- # uname 00:18:17.630 07:16:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:17.630 07:16:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1924842 00:18:17.630 07:16:20 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:17.630 07:16:20 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:17.630 07:16:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1924842' 00:18:17.630 killing process with pid 1924842 00:18:17.630 07:16:20 -- common/autotest_common.sh@945 -- # kill 1924842 00:18:17.630 Received shutdown signal, test time was about 10.000000 seconds 00:18:17.630 00:18:17.630 Latency(us) 00:18:17.630 [2024-10-16T05:16:20.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.630 [2024-10-16T05:16:20.570Z] =================================================================================================================== 00:18:17.630 [2024-10-16T05:16:20.570Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:17.630 07:16:20 -- common/autotest_common.sh@950 -- # wait 1924842 00:18:17.888 07:16:20 -- target/tls.sh@209 -- # killprocess 1924414 00:18:17.888 07:16:20 -- common/autotest_common.sh@926 -- # '[' -z 1924414 ']' 00:18:17.888 07:16:20 -- common/autotest_common.sh@930 -- # kill -0 1924414 00:18:17.888 07:16:20 -- common/autotest_common.sh@931 -- # uname 00:18:17.888 07:16:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:17.888 07:16:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1924414 00:18:17.888 07:16:20 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:17.888 07:16:20 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:17.888 07:16:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1924414' 00:18:17.888 killing process with pid 1924414 00:18:17.888 07:16:20 -- common/autotest_common.sh@945 -- # kill 1924414 00:18:17.888 07:16:20 -- common/autotest_common.sh@950 -- # wait 1924414 00:18:18.147 07:16:21 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:18.147 07:16:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:18.147 07:16:21 -- target/tls.sh@212 -- # echo '{ 00:18:18.147 "subsystems": [ 00:18:18.147 { 00:18:18.147 "subsystem": "iobuf", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "iobuf_set_options", 00:18:18.147 "params": { 00:18:18.147 "small_pool_count": 8192, 00:18:18.147 "large_pool_count": 1024, 00:18:18.147 "small_bufsize": 8192, 00:18:18.147 "large_bufsize": 135168 00:18:18.147 } 00:18:18.147 } 00:18:18.147 ] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "sock", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "sock_impl_set_options", 00:18:18.147 "params": { 00:18:18.147 "impl_name": "posix", 00:18:18.147 "recv_buf_size": 2097152, 00:18:18.147 "send_buf_size": 2097152, 00:18:18.147 "enable_recv_pipe": true, 00:18:18.147 "enable_quickack": false, 00:18:18.147 "enable_placement_id": 0, 00:18:18.147 "enable_zerocopy_send_server": true, 00:18:18.147 "enable_zerocopy_send_client": false, 00:18:18.147 "zerocopy_threshold": 0, 00:18:18.147 "tls_version": 0, 00:18:18.147 "enable_ktls": false 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "sock_impl_set_options", 00:18:18.147 "params": { 00:18:18.147 "impl_name": "ssl", 00:18:18.147 "recv_buf_size": 4096, 00:18:18.147 "send_buf_size": 4096, 00:18:18.147 "enable_recv_pipe": true, 00:18:18.147 "enable_quickack": false, 00:18:18.147 "enable_placement_id": 0, 00:18:18.147 "enable_zerocopy_send_server": true, 00:18:18.147 "enable_zerocopy_send_client": false, 00:18:18.147 "zerocopy_threshold": 0, 00:18:18.147 "tls_version": 0, 00:18:18.147 "enable_ktls": false 00:18:18.147 } 00:18:18.147 } 00:18:18.147 ] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "vmd", 00:18:18.147 "config": [] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "accel", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "accel_set_options", 00:18:18.147 "params": { 00:18:18.147 "small_cache_size": 128, 00:18:18.147 "large_cache_size": 16, 00:18:18.147 "task_count": 2048, 00:18:18.147 "sequence_count": 2048, 00:18:18.147 "buf_count": 2048 00:18:18.147 } 00:18:18.147 } 00:18:18.147 ] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "bdev", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "bdev_set_options", 00:18:18.147 "params": { 00:18:18.147 "bdev_io_pool_size": 65535, 00:18:18.147 "bdev_io_cache_size": 256, 00:18:18.147 "bdev_auto_examine": true, 00:18:18.147 "iobuf_small_cache_size": 128, 00:18:18.147 "iobuf_large_cache_size": 16 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_raid_set_options", 00:18:18.147 "params": { 00:18:18.147 "process_window_size_kb": 1024 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_iscsi_set_options", 00:18:18.147 "params": { 00:18:18.147 "timeout_sec": 30 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_nvme_set_options", 00:18:18.147 "params": { 00:18:18.147 "action_on_timeout": "none", 00:18:18.147 "timeout_us": 0, 00:18:18.147 "timeout_admin_us": 0, 00:18:18.147 "keep_alive_timeout_ms": 10000, 00:18:18.147 "transport_retry_count": 4, 00:18:18.147 "arbitration_burst": 0, 00:18:18.147 "low_priority_weight": 0, 00:18:18.147 "medium_priority_weight": 0, 00:18:18.147 "high_priority_weight": 0, 00:18:18.147 "nvme_adminq_poll_period_us": 10000, 00:18:18.147 "nvme_ioq_poll_period_us": 0, 00:18:18.147 "io_queue_requests": 0, 00:18:18.147 "delay_cmd_submit": true, 00:18:18.147 "bdev_retry_count": 3, 00:18:18.147 "transport_ack_timeout": 0, 00:18:18.147 "ctrlr_loss_timeout_sec": 0, 00:18:18.147 "reconnect_delay_sec": 0, 00:18:18.147 "fast_io_fail_timeout_sec": 0, 00:18:18.147 "generate_uuids": false, 00:18:18.147 "transport_tos": 0, 00:18:18.147 "io_path_stat": false, 00:18:18.147 "allow_accel_sequence": false 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_nvme_set_hotplug", 00:18:18.147 "params": { 00:18:18.147 "period_us": 100000, 00:18:18.147 "enable": false 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_malloc_create", 00:18:18.147 "params": { 00:18:18.147 "name": "malloc0", 00:18:18.147 "num_blocks": 8192, 00:18:18.147 "block_size": 4096, 00:18:18.147 "physical_block_size": 4096, 00:18:18.147 "uuid": "2507ff91-912e-4887-ae7c-80b6a3a0d8c2", 00:18:18.147 "optimal_io_boundary": 0 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "bdev_wait_for_examine" 00:18:18.147 } 00:18:18.147 ] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "nbd", 00:18:18.147 "config": [] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "scheduler", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "framework_set_scheduler", 00:18:18.147 "params": { 00:18:18.147 "name": "static" 00:18:18.147 } 00:18:18.147 } 00:18:18.147 ] 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "subsystem": "nvmf", 00:18:18.147 "config": [ 00:18:18.147 { 00:18:18.147 "method": "nvmf_set_config", 00:18:18.147 "params": { 00:18:18.147 "discovery_filter": "match_any", 00:18:18.147 "admin_cmd_passthru": { 00:18:18.147 "identify_ctrlr": false 00:18:18.147 } 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_set_max_subsystems", 00:18:18.147 "params": { 00:18:18.147 "max_subsystems": 1024 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_set_crdt", 00:18:18.147 "params": { 00:18:18.147 "crdt1": 0, 00:18:18.147 "crdt2": 0, 00:18:18.147 "crdt3": 0 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_create_transport", 00:18:18.147 "params": { 00:18:18.147 "trtype": "TCP", 00:18:18.147 "max_queue_depth": 128, 00:18:18.147 "max_io_qpairs_per_ctrlr": 127, 00:18:18.147 "in_capsule_data_size": 4096, 00:18:18.147 "max_io_size": 131072, 00:18:18.147 "io_unit_size": 131072, 00:18:18.147 "max_aq_depth": 128, 00:18:18.147 "num_shared_buffers": 511, 00:18:18.147 "buf_cache_size": 4294967295, 00:18:18.147 "dif_insert_or_strip": false, 00:18:18.147 "zcopy": false, 00:18:18.147 "c2h_success": false, 00:18:18.147 "sock_priority": 0, 00:18:18.147 "abort_timeout_sec": 1 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_create_subsystem", 00:18:18.147 "params": { 00:18:18.147 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.147 "allow_any_host": false, 00:18:18.147 "serial_number": "SPDK00000000000001", 00:18:18.147 "model_number": "SPDK bdev Controller", 00:18:18.147 "max_namespaces": 10, 00:18:18.147 "min_cntlid": 1, 00:18:18.147 "max_cntlid": 65519, 00:18:18.147 "ana_reporting": false 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_subsystem_add_host", 00:18:18.147 "params": { 00:18:18.147 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.147 "host": "nqn.2016-06.io.spdk:host1", 00:18:18.147 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_subsystem_add_ns", 00:18:18.147 "params": { 00:18:18.147 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.147 "namespace": { 00:18:18.147 "nsid": 1, 00:18:18.147 "bdev_name": "malloc0", 00:18:18.147 "nguid": "2507FF91912E4887AE7C80B6A3A0D8C2", 00:18:18.147 "uuid": "2507ff91-912e-4887-ae7c-80b6a3a0d8c2" 00:18:18.147 } 00:18:18.147 } 00:18:18.147 }, 00:18:18.147 { 00:18:18.147 "method": "nvmf_subsystem_add_listener", 00:18:18.147 "params": { 00:18:18.147 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.148 "listen_address": { 00:18:18.148 "trtype": "TCP", 00:18:18.148 "adrfam": "IPv4", 00:18:18.148 "traddr": "10.0.0.2", 00:18:18.148 "trsvcid": "4420" 00:18:18.148 }, 00:18:18.148 "secure_channel": true 00:18:18.148 } 00:18:18.148 } 00:18:18.148 ] 00:18:18.148 } 00:18:18.148 ] 00:18:18.148 }' 00:18:18.148 07:16:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:18.148 07:16:21 -- common/autotest_common.sh@10 -- # set +x 00:18:18.148 07:16:21 -- nvmf/common.sh@469 -- # nvmfpid=1925137 00:18:18.148 07:16:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:18.148 07:16:21 -- nvmf/common.sh@470 -- # waitforlisten 1925137 00:18:18.148 07:16:21 -- common/autotest_common.sh@819 -- # '[' -z 1925137 ']' 00:18:18.148 07:16:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:18.148 07:16:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:18.148 07:16:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:18.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:18.148 07:16:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:18.148 07:16:21 -- common/autotest_common.sh@10 -- # set +x 00:18:18.148 [2024-10-16 07:16:21.075829] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:18.148 [2024-10-16 07:16:21.075914] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:18.406 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.406 [2024-10-16 07:16:21.148125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.406 [2024-10-16 07:16:21.264625] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:18.406 [2024-10-16 07:16:21.264801] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:18.406 [2024-10-16 07:16:21.264822] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:18.406 [2024-10-16 07:16:21.264835] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:18.406 [2024-10-16 07:16:21.264869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:18.664 [2024-10-16 07:16:21.487415] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.664 [2024-10-16 07:16:21.519437] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:18.664 [2024-10-16 07:16:21.519688] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:19.230 07:16:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:19.230 07:16:22 -- common/autotest_common.sh@852 -- # return 0 00:18:19.230 07:16:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:19.230 07:16:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:19.230 07:16:22 -- common/autotest_common.sh@10 -- # set +x 00:18:19.230 07:16:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:19.230 07:16:22 -- target/tls.sh@216 -- # bdevperf_pid=1925295 00:18:19.230 07:16:22 -- target/tls.sh@217 -- # waitforlisten 1925295 /var/tmp/bdevperf.sock 00:18:19.230 07:16:22 -- common/autotest_common.sh@819 -- # '[' -z 1925295 ']' 00:18:19.230 07:16:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:19.230 07:16:22 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:19.230 07:16:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:19.230 07:16:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:19.230 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:19.230 07:16:22 -- target/tls.sh@213 -- # echo '{ 00:18:19.230 "subsystems": [ 00:18:19.230 { 00:18:19.230 "subsystem": "iobuf", 00:18:19.230 "config": [ 00:18:19.230 { 00:18:19.230 "method": "iobuf_set_options", 00:18:19.230 "params": { 00:18:19.230 "small_pool_count": 8192, 00:18:19.230 "large_pool_count": 1024, 00:18:19.230 "small_bufsize": 8192, 00:18:19.230 "large_bufsize": 135168 00:18:19.230 } 00:18:19.230 } 00:18:19.230 ] 00:18:19.230 }, 00:18:19.230 { 00:18:19.230 "subsystem": "sock", 00:18:19.230 "config": [ 00:18:19.230 { 00:18:19.230 "method": "sock_impl_set_options", 00:18:19.230 "params": { 00:18:19.230 "impl_name": "posix", 00:18:19.230 "recv_buf_size": 2097152, 00:18:19.230 "send_buf_size": 2097152, 00:18:19.230 "enable_recv_pipe": true, 00:18:19.230 "enable_quickack": false, 00:18:19.230 "enable_placement_id": 0, 00:18:19.230 "enable_zerocopy_send_server": true, 00:18:19.230 "enable_zerocopy_send_client": false, 00:18:19.230 "zerocopy_threshold": 0, 00:18:19.230 "tls_version": 0, 00:18:19.230 "enable_ktls": false 00:18:19.230 } 00:18:19.230 }, 00:18:19.230 { 00:18:19.230 "method": "sock_impl_set_options", 00:18:19.230 "params": { 00:18:19.230 "impl_name": "ssl", 00:18:19.230 "recv_buf_size": 4096, 00:18:19.230 "send_buf_size": 4096, 00:18:19.230 "enable_recv_pipe": true, 00:18:19.231 "enable_quickack": false, 00:18:19.231 "enable_placement_id": 0, 00:18:19.231 "enable_zerocopy_send_server": true, 00:18:19.231 "enable_zerocopy_send_client": false, 00:18:19.231 "zerocopy_threshold": 0, 00:18:19.231 "tls_version": 0, 00:18:19.231 "enable_ktls": false 00:18:19.231 } 00:18:19.231 } 00:18:19.231 ] 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "subsystem": "vmd", 00:18:19.231 "config": [] 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "subsystem": "accel", 00:18:19.231 "config": [ 00:18:19.231 { 00:18:19.231 "method": "accel_set_options", 00:18:19.231 "params": { 00:18:19.231 "small_cache_size": 128, 00:18:19.231 "large_cache_size": 16, 00:18:19.231 "task_count": 2048, 00:18:19.231 "sequence_count": 2048, 00:18:19.231 "buf_count": 2048 00:18:19.231 } 00:18:19.231 } 00:18:19.231 ] 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "subsystem": "bdev", 00:18:19.231 "config": [ 00:18:19.231 { 00:18:19.231 "method": "bdev_set_options", 00:18:19.231 "params": { 00:18:19.231 "bdev_io_pool_size": 65535, 00:18:19.231 "bdev_io_cache_size": 256, 00:18:19.231 "bdev_auto_examine": true, 00:18:19.231 "iobuf_small_cache_size": 128, 00:18:19.231 "iobuf_large_cache_size": 16 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_raid_set_options", 00:18:19.231 "params": { 00:18:19.231 "process_window_size_kb": 1024 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_iscsi_set_options", 00:18:19.231 "params": { 00:18:19.231 "timeout_sec": 30 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_nvme_set_options", 00:18:19.231 "params": { 00:18:19.231 "action_on_timeout": "none", 00:18:19.231 "timeout_us": 0, 00:18:19.231 "timeout_admin_us": 0, 00:18:19.231 "keep_alive_timeout_ms": 10000, 00:18:19.231 "transport_retry_count": 4, 00:18:19.231 "arbitration_burst": 0, 00:18:19.231 "low_priority_weight": 0, 00:18:19.231 "medium_priority_weight": 0, 00:18:19.231 "high_priority_weight": 0, 00:18:19.231 "nvme_adminq_poll_period_us": 10000, 00:18:19.231 "nvme_ioq_poll_period_us": 0, 00:18:19.231 "io_queue_requests": 512, 00:18:19.231 "delay_cmd_submit": true, 00:18:19.231 "bdev_retry_count": 3, 00:18:19.231 "transport_ack_timeout": 0, 00:18:19.231 "ctrlr_loss_timeout_sec": 0, 00:18:19.231 "reconnect_delay_sec": 0, 00:18:19.231 "fast_io_fail_timeout_sec": 0, 00:18:19.231 "generate_uuids": false, 00:18:19.231 "transport_tos": 0, 00:18:19.231 "io_path_stat": false, 00:18:19.231 "allow_accel_sequence": false 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_nvme_attach_controller", 00:18:19.231 "params": { 00:18:19.231 "name": "TLSTEST", 00:18:19.231 "trtype": "TCP", 00:18:19.231 "adrfam": "IPv4", 00:18:19.231 "traddr": "10.0.0.2", 00:18:19.231 "trsvcid": "4420", 00:18:19.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.231 "prchk_reftag": false, 00:18:19.231 "prchk_guard": false, 00:18:19.231 "ctrlr_loss_timeout_sec": 0, 00:18:19.231 "reconnect_delay_sec": 0, 00:18:19.231 "fast_io_fail_timeout_sec": 0, 00:18:19.231 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:19.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.231 "hdgst": false, 00:18:19.231 "ddgst": false 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_nvme_set_hotplug", 00:18:19.231 "params": { 00:18:19.231 "period_us": 100000, 00:18:19.231 "enable": false 00:18:19.231 } 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "method": "bdev_wait_for_examine" 00:18:19.231 } 00:18:19.231 ] 00:18:19.231 }, 00:18:19.231 { 00:18:19.231 "subsystem": "nbd", 00:18:19.231 "config": [] 00:18:19.231 } 00:18:19.231 ] 00:18:19.231 }' 00:18:19.231 07:16:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:19.231 07:16:22 -- common/autotest_common.sh@10 -- # set +x 00:18:19.231 [2024-10-16 07:16:22.111994] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:19.231 [2024-10-16 07:16:22.112067] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1925295 ] 00:18:19.231 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.231 [2024-10-16 07:16:22.167914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.490 [2024-10-16 07:16:22.271802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:19.490 [2024-10-16 07:16:22.429547] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:20.424 07:16:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:20.424 07:16:23 -- common/autotest_common.sh@852 -- # return 0 00:18:20.424 07:16:23 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:20.424 Running I/O for 10 seconds... 00:18:30.448 00:18:30.448 Latency(us) 00:18:30.448 [2024-10-16T05:16:33.388Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.448 [2024-10-16T05:16:33.388Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:30.448 Verification LBA range: start 0x0 length 0x2000 00:18:30.448 TLSTESTn1 : 10.03 4789.60 18.71 0.00 0.00 26676.84 7815.77 43690.67 00:18:30.448 [2024-10-16T05:16:33.388Z] =================================================================================================================== 00:18:30.448 [2024-10-16T05:16:33.388Z] Total : 4789.60 18.71 0.00 0.00 26676.84 7815.77 43690.67 00:18:30.448 0 00:18:30.448 07:16:33 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:30.448 07:16:33 -- target/tls.sh@223 -- # killprocess 1925295 00:18:30.448 07:16:33 -- common/autotest_common.sh@926 -- # '[' -z 1925295 ']' 00:18:30.448 07:16:33 -- common/autotest_common.sh@930 -- # kill -0 1925295 00:18:30.448 07:16:33 -- common/autotest_common.sh@931 -- # uname 00:18:30.448 07:16:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:30.448 07:16:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1925295 00:18:30.448 07:16:33 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:30.448 07:16:33 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:30.448 07:16:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1925295' 00:18:30.448 killing process with pid 1925295 00:18:30.448 07:16:33 -- common/autotest_common.sh@945 -- # kill 1925295 00:18:30.448 Received shutdown signal, test time was about 10.000000 seconds 00:18:30.448 00:18:30.448 Latency(us) 00:18:30.448 [2024-10-16T05:16:33.388Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:30.448 [2024-10-16T05:16:33.388Z] =================================================================================================================== 00:18:30.448 [2024-10-16T05:16:33.388Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:30.448 07:16:33 -- common/autotest_common.sh@950 -- # wait 1925295 00:18:30.706 07:16:33 -- target/tls.sh@224 -- # killprocess 1925137 00:18:30.706 07:16:33 -- common/autotest_common.sh@926 -- # '[' -z 1925137 ']' 00:18:30.706 07:16:33 -- common/autotest_common.sh@930 -- # kill -0 1925137 00:18:30.706 07:16:33 -- common/autotest_common.sh@931 -- # uname 00:18:30.706 07:16:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:30.706 07:16:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1925137 00:18:30.706 07:16:33 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:30.706 07:16:33 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:30.706 07:16:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1925137' 00:18:30.706 killing process with pid 1925137 00:18:30.706 07:16:33 -- common/autotest_common.sh@945 -- # kill 1925137 00:18:30.706 07:16:33 -- common/autotest_common.sh@950 -- # wait 1925137 00:18:30.963 07:16:33 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:30.963 07:16:33 -- target/tls.sh@227 -- # cleanup 00:18:30.963 07:16:33 -- target/tls.sh@15 -- # process_shm --id 0 00:18:30.963 07:16:33 -- common/autotest_common.sh@796 -- # type=--id 00:18:30.963 07:16:33 -- common/autotest_common.sh@797 -- # id=0 00:18:30.963 07:16:33 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:30.963 07:16:33 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:30.963 07:16:33 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:30.963 07:16:33 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:30.963 07:16:33 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:30.963 07:16:33 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:30.963 nvmf_trace.0 00:18:30.963 07:16:33 -- common/autotest_common.sh@811 -- # return 0 00:18:30.963 07:16:33 -- target/tls.sh@16 -- # killprocess 1925295 00:18:30.963 07:16:33 -- common/autotest_common.sh@926 -- # '[' -z 1925295 ']' 00:18:30.963 07:16:33 -- common/autotest_common.sh@930 -- # kill -0 1925295 00:18:30.963 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1925295) - No such process 00:18:30.963 07:16:33 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1925295 is not found' 00:18:30.963 Process with pid 1925295 is not found 00:18:30.963 07:16:33 -- target/tls.sh@17 -- # nvmftestfini 00:18:30.963 07:16:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:30.963 07:16:33 -- nvmf/common.sh@116 -- # sync 00:18:30.963 07:16:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:30.963 07:16:33 -- nvmf/common.sh@119 -- # set +e 00:18:30.963 07:16:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:30.963 07:16:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:31.220 rmmod nvme_tcp 00:18:31.220 rmmod nvme_fabrics 00:18:31.220 rmmod nvme_keyring 00:18:31.220 07:16:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:31.220 07:16:33 -- nvmf/common.sh@123 -- # set -e 00:18:31.220 07:16:33 -- nvmf/common.sh@124 -- # return 0 00:18:31.220 07:16:33 -- nvmf/common.sh@477 -- # '[' -n 1925137 ']' 00:18:31.220 07:16:33 -- nvmf/common.sh@478 -- # killprocess 1925137 00:18:31.220 07:16:33 -- common/autotest_common.sh@926 -- # '[' -z 1925137 ']' 00:18:31.220 07:16:33 -- common/autotest_common.sh@930 -- # kill -0 1925137 00:18:31.221 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1925137) - No such process 00:18:31.221 07:16:33 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1925137 is not found' 00:18:31.221 Process with pid 1925137 is not found 00:18:31.221 07:16:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:31.221 07:16:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:31.221 07:16:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:31.221 07:16:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:31.221 07:16:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:31.221 07:16:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:31.221 07:16:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:31.221 07:16:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:33.116 07:16:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:33.116 07:16:35 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:33.116 00:18:33.116 real 1m16.930s 00:18:33.116 user 2m6.494s 00:18:33.116 sys 0m22.335s 00:18:33.116 07:16:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:33.116 07:16:35 -- common/autotest_common.sh@10 -- # set +x 00:18:33.116 ************************************ 00:18:33.116 END TEST nvmf_tls 00:18:33.116 ************************************ 00:18:33.116 07:16:36 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:33.116 07:16:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:33.116 07:16:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:33.116 07:16:36 -- common/autotest_common.sh@10 -- # set +x 00:18:33.116 ************************************ 00:18:33.116 START TEST nvmf_fips 00:18:33.116 ************************************ 00:18:33.116 07:16:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:33.375 * Looking for test storage... 00:18:33.375 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:33.375 07:16:36 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:33.375 07:16:36 -- nvmf/common.sh@7 -- # uname -s 00:18:33.375 07:16:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:33.375 07:16:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:33.375 07:16:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:33.375 07:16:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:33.375 07:16:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:33.375 07:16:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:33.375 07:16:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:33.375 07:16:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:33.375 07:16:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:33.375 07:16:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:33.375 07:16:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:33.375 07:16:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:33.375 07:16:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:33.375 07:16:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:33.375 07:16:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:33.375 07:16:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:33.375 07:16:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:33.375 07:16:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:33.375 07:16:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:33.375 07:16:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.375 07:16:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.375 07:16:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.375 07:16:36 -- paths/export.sh@5 -- # export PATH 00:18:33.375 07:16:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:33.375 07:16:36 -- nvmf/common.sh@46 -- # : 0 00:18:33.375 07:16:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:33.375 07:16:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:33.375 07:16:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:33.375 07:16:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:33.375 07:16:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:33.375 07:16:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:33.375 07:16:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:33.375 07:16:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:33.375 07:16:36 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.375 07:16:36 -- fips/fips.sh@89 -- # check_openssl_version 00:18:33.375 07:16:36 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:33.375 07:16:36 -- fips/fips.sh@85 -- # openssl version 00:18:33.375 07:16:36 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:33.375 07:16:36 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:33.375 07:16:36 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:33.375 07:16:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:33.375 07:16:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:33.375 07:16:36 -- scripts/common.sh@335 -- # IFS=.-: 00:18:33.375 07:16:36 -- scripts/common.sh@335 -- # read -ra ver1 00:18:33.375 07:16:36 -- scripts/common.sh@336 -- # IFS=.-: 00:18:33.375 07:16:36 -- scripts/common.sh@336 -- # read -ra ver2 00:18:33.375 07:16:36 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:33.375 07:16:36 -- scripts/common.sh@339 -- # ver1_l=3 00:18:33.375 07:16:36 -- scripts/common.sh@340 -- # ver2_l=3 00:18:33.375 07:16:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:33.375 07:16:36 -- scripts/common.sh@343 -- # case "$op" in 00:18:33.375 07:16:36 -- scripts/common.sh@347 -- # : 1 00:18:33.375 07:16:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:33.375 07:16:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:33.375 07:16:36 -- scripts/common.sh@364 -- # decimal 3 00:18:33.375 07:16:36 -- scripts/common.sh@352 -- # local d=3 00:18:33.375 07:16:36 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:33.375 07:16:36 -- scripts/common.sh@354 -- # echo 3 00:18:33.375 07:16:36 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:33.375 07:16:36 -- scripts/common.sh@365 -- # decimal 3 00:18:33.375 07:16:36 -- scripts/common.sh@352 -- # local d=3 00:18:33.375 07:16:36 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:33.375 07:16:36 -- scripts/common.sh@354 -- # echo 3 00:18:33.375 07:16:36 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:33.375 07:16:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:33.375 07:16:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:33.375 07:16:36 -- scripts/common.sh@363 -- # (( v++ )) 00:18:33.375 07:16:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:33.375 07:16:36 -- scripts/common.sh@364 -- # decimal 1 00:18:33.375 07:16:36 -- scripts/common.sh@352 -- # local d=1 00:18:33.375 07:16:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:33.376 07:16:36 -- scripts/common.sh@354 -- # echo 1 00:18:33.376 07:16:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:33.376 07:16:36 -- scripts/common.sh@365 -- # decimal 0 00:18:33.376 07:16:36 -- scripts/common.sh@352 -- # local d=0 00:18:33.376 07:16:36 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:33.376 07:16:36 -- scripts/common.sh@354 -- # echo 0 00:18:33.376 07:16:36 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:33.376 07:16:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:33.376 07:16:36 -- scripts/common.sh@366 -- # return 0 00:18:33.376 07:16:36 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:33.376 07:16:36 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:33.376 07:16:36 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:33.376 07:16:36 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:33.376 07:16:36 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:33.376 07:16:36 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:33.376 07:16:36 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:33.376 07:16:36 -- fips/fips.sh@113 -- # build_openssl_config 00:18:33.376 07:16:36 -- fips/fips.sh@37 -- # cat 00:18:33.376 07:16:36 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:33.376 07:16:36 -- fips/fips.sh@58 -- # cat - 00:18:33.376 07:16:36 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:33.376 07:16:36 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:33.376 07:16:36 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:33.376 07:16:36 -- fips/fips.sh@116 -- # openssl list -providers 00:18:33.376 07:16:36 -- fips/fips.sh@116 -- # grep name 00:18:33.376 07:16:36 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:33.376 07:16:36 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:33.376 07:16:36 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:33.376 07:16:36 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:33.376 07:16:36 -- fips/fips.sh@127 -- # : 00:18:33.376 07:16:36 -- common/autotest_common.sh@640 -- # local es=0 00:18:33.376 07:16:36 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:33.376 07:16:36 -- common/autotest_common.sh@628 -- # local arg=openssl 00:18:33.376 07:16:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.376 07:16:36 -- common/autotest_common.sh@632 -- # type -t openssl 00:18:33.376 07:16:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.376 07:16:36 -- common/autotest_common.sh@634 -- # type -P openssl 00:18:33.376 07:16:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:18:33.376 07:16:36 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:18:33.376 07:16:36 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:18:33.376 07:16:36 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:18:33.376 Error setting digest 00:18:33.376 4072B1289D7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:33.376 4072B1289D7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:33.376 07:16:36 -- common/autotest_common.sh@643 -- # es=1 00:18:33.376 07:16:36 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:18:33.376 07:16:36 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:18:33.376 07:16:36 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:18:33.376 07:16:36 -- fips/fips.sh@130 -- # nvmftestinit 00:18:33.376 07:16:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:33.376 07:16:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:33.376 07:16:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:33.376 07:16:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:33.376 07:16:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:33.376 07:16:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:33.376 07:16:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:33.376 07:16:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:33.376 07:16:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:33.376 07:16:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:33.376 07:16:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:33.376 07:16:36 -- common/autotest_common.sh@10 -- # set +x 00:18:35.905 07:16:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:35.905 07:16:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:35.905 07:16:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:35.905 07:16:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:35.905 07:16:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:35.905 07:16:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:35.905 07:16:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:35.905 07:16:38 -- nvmf/common.sh@294 -- # net_devs=() 00:18:35.905 07:16:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:35.905 07:16:38 -- nvmf/common.sh@295 -- # e810=() 00:18:35.905 07:16:38 -- nvmf/common.sh@295 -- # local -ga e810 00:18:35.905 07:16:38 -- nvmf/common.sh@296 -- # x722=() 00:18:35.905 07:16:38 -- nvmf/common.sh@296 -- # local -ga x722 00:18:35.905 07:16:38 -- nvmf/common.sh@297 -- # mlx=() 00:18:35.905 07:16:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:35.905 07:16:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:35.905 07:16:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:35.905 07:16:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:35.905 07:16:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:35.905 07:16:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:35.905 07:16:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:35.905 07:16:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:35.905 07:16:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.905 07:16:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:35.906 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:35.906 07:16:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:35.906 07:16:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:35.906 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:35.906 07:16:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:35.906 07:16:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.906 07:16:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.906 07:16:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.906 07:16:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.906 07:16:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:35.906 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:35.906 07:16:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.906 07:16:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:35.906 07:16:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.906 07:16:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:35.906 07:16:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.906 07:16:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:35.906 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:35.906 07:16:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.906 07:16:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:35.906 07:16:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:35.906 07:16:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:35.906 07:16:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:35.906 07:16:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:35.906 07:16:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:35.906 07:16:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:35.906 07:16:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:35.906 07:16:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:35.906 07:16:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:35.906 07:16:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:35.906 07:16:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:35.906 07:16:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:35.906 07:16:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:35.906 07:16:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:35.906 07:16:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:35.906 07:16:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:35.906 07:16:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:35.906 07:16:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:35.906 07:16:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:35.906 07:16:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:35.906 07:16:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:35.906 07:16:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:35.906 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:35.906 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:18:35.906 00:18:35.906 --- 10.0.0.2 ping statistics --- 00:18:35.906 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.906 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:18:35.906 07:16:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:35.906 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:35.906 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:18:35.906 00:18:35.906 --- 10.0.0.1 ping statistics --- 00:18:35.906 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:35.906 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:18:35.906 07:16:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:35.906 07:16:38 -- nvmf/common.sh@410 -- # return 0 00:18:35.906 07:16:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:35.906 07:16:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:35.906 07:16:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:35.906 07:16:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:35.906 07:16:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:35.906 07:16:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:35.906 07:16:38 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:35.906 07:16:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:35.906 07:16:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:35.906 07:16:38 -- common/autotest_common.sh@10 -- # set +x 00:18:35.906 07:16:38 -- nvmf/common.sh@469 -- # nvmfpid=1928750 00:18:35.906 07:16:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:35.906 07:16:38 -- nvmf/common.sh@470 -- # waitforlisten 1928750 00:18:35.906 07:16:38 -- common/autotest_common.sh@819 -- # '[' -z 1928750 ']' 00:18:35.906 07:16:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:35.906 07:16:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:35.906 07:16:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:35.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:35.906 07:16:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:35.906 07:16:38 -- common/autotest_common.sh@10 -- # set +x 00:18:35.906 [2024-10-16 07:16:38.547620] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:35.906 [2024-10-16 07:16:38.547689] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:35.906 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.906 [2024-10-16 07:16:38.613723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:35.906 [2024-10-16 07:16:38.731200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:35.906 [2024-10-16 07:16:38.731361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:35.906 [2024-10-16 07:16:38.731381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:35.906 [2024-10-16 07:16:38.731395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:35.906 [2024-10-16 07:16:38.731427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:36.839 07:16:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:36.839 07:16:39 -- common/autotest_common.sh@852 -- # return 0 00:18:36.839 07:16:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:36.839 07:16:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:36.839 07:16:39 -- common/autotest_common.sh@10 -- # set +x 00:18:36.839 07:16:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:36.839 07:16:39 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:36.839 07:16:39 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:36.839 07:16:39 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:36.839 07:16:39 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:36.839 07:16:39 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:36.839 07:16:39 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:36.839 07:16:39 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:36.839 07:16:39 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:37.097 [2024-10-16 07:16:39.830310] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:37.097 [2024-10-16 07:16:39.846281] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:37.097 [2024-10-16 07:16:39.846526] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:37.097 malloc0 00:18:37.097 07:16:39 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:37.097 07:16:39 -- fips/fips.sh@147 -- # bdevperf_pid=1928907 00:18:37.097 07:16:39 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:37.097 07:16:39 -- fips/fips.sh@148 -- # waitforlisten 1928907 /var/tmp/bdevperf.sock 00:18:37.097 07:16:39 -- common/autotest_common.sh@819 -- # '[' -z 1928907 ']' 00:18:37.097 07:16:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:37.097 07:16:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:37.097 07:16:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:37.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:37.097 07:16:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:37.097 07:16:39 -- common/autotest_common.sh@10 -- # set +x 00:18:37.097 [2024-10-16 07:16:39.999580] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:37.097 [2024-10-16 07:16:39.999687] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1928907 ] 00:18:37.355 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.355 [2024-10-16 07:16:40.081123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.355 [2024-10-16 07:16:40.194309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:38.288 07:16:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:38.288 07:16:40 -- common/autotest_common.sh@852 -- # return 0 00:18:38.288 07:16:40 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:38.288 [2024-10-16 07:16:41.165384] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:38.546 TLSTESTn1 00:18:38.546 07:16:41 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:38.546 Running I/O for 10 seconds... 00:18:48.512 00:18:48.512 Latency(us) 00:18:48.512 [2024-10-16T05:16:51.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:48.512 [2024-10-16T05:16:51.452Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:48.512 Verification LBA range: start 0x0 length 0x2000 00:18:48.512 TLSTESTn1 : 10.02 4612.50 18.02 0.00 0.00 27707.10 5048.70 41554.68 00:18:48.512 [2024-10-16T05:16:51.452Z] =================================================================================================================== 00:18:48.512 [2024-10-16T05:16:51.452Z] Total : 4612.50 18.02 0.00 0.00 27707.10 5048.70 41554.68 00:18:48.512 0 00:18:48.512 07:16:51 -- fips/fips.sh@1 -- # cleanup 00:18:48.512 07:16:51 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:48.512 07:16:51 -- common/autotest_common.sh@796 -- # type=--id 00:18:48.512 07:16:51 -- common/autotest_common.sh@797 -- # id=0 00:18:48.512 07:16:51 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:48.512 07:16:51 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:48.512 07:16:51 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:48.512 07:16:51 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:48.512 07:16:51 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:48.512 07:16:51 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:48.512 nvmf_trace.0 00:18:48.770 07:16:51 -- common/autotest_common.sh@811 -- # return 0 00:18:48.770 07:16:51 -- fips/fips.sh@16 -- # killprocess 1928907 00:18:48.770 07:16:51 -- common/autotest_common.sh@926 -- # '[' -z 1928907 ']' 00:18:48.770 07:16:51 -- common/autotest_common.sh@930 -- # kill -0 1928907 00:18:48.770 07:16:51 -- common/autotest_common.sh@931 -- # uname 00:18:48.770 07:16:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:48.770 07:16:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1928907 00:18:48.770 07:16:51 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:48.770 07:16:51 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:48.770 07:16:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1928907' 00:18:48.770 killing process with pid 1928907 00:18:48.770 07:16:51 -- common/autotest_common.sh@945 -- # kill 1928907 00:18:48.770 Received shutdown signal, test time was about 10.000000 seconds 00:18:48.770 00:18:48.770 Latency(us) 00:18:48.770 [2024-10-16T05:16:51.710Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:48.770 [2024-10-16T05:16:51.710Z] =================================================================================================================== 00:18:48.770 [2024-10-16T05:16:51.710Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:48.770 07:16:51 -- common/autotest_common.sh@950 -- # wait 1928907 00:18:49.028 07:16:51 -- fips/fips.sh@17 -- # nvmftestfini 00:18:49.028 07:16:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:49.028 07:16:51 -- nvmf/common.sh@116 -- # sync 00:18:49.028 07:16:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:49.028 07:16:51 -- nvmf/common.sh@119 -- # set +e 00:18:49.028 07:16:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:49.028 07:16:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:49.028 rmmod nvme_tcp 00:18:49.028 rmmod nvme_fabrics 00:18:49.028 rmmod nvme_keyring 00:18:49.028 07:16:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:49.028 07:16:51 -- nvmf/common.sh@123 -- # set -e 00:18:49.028 07:16:51 -- nvmf/common.sh@124 -- # return 0 00:18:49.028 07:16:51 -- nvmf/common.sh@477 -- # '[' -n 1928750 ']' 00:18:49.028 07:16:51 -- nvmf/common.sh@478 -- # killprocess 1928750 00:18:49.028 07:16:51 -- common/autotest_common.sh@926 -- # '[' -z 1928750 ']' 00:18:49.028 07:16:51 -- common/autotest_common.sh@930 -- # kill -0 1928750 00:18:49.029 07:16:51 -- common/autotest_common.sh@931 -- # uname 00:18:49.029 07:16:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:49.029 07:16:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1928750 00:18:49.029 07:16:51 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:49.029 07:16:51 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:49.029 07:16:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1928750' 00:18:49.029 killing process with pid 1928750 00:18:49.029 07:16:51 -- common/autotest_common.sh@945 -- # kill 1928750 00:18:49.029 07:16:51 -- common/autotest_common.sh@950 -- # wait 1928750 00:18:49.287 07:16:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:49.287 07:16:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:49.287 07:16:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:49.287 07:16:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:49.287 07:16:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:49.287 07:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:49.287 07:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:49.287 07:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.815 07:16:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:51.815 07:16:54 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:51.815 00:18:51.815 real 0m18.161s 00:18:51.815 user 0m23.914s 00:18:51.815 sys 0m5.847s 00:18:51.815 07:16:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:51.815 07:16:54 -- common/autotest_common.sh@10 -- # set +x 00:18:51.815 ************************************ 00:18:51.815 END TEST nvmf_fips 00:18:51.815 ************************************ 00:18:51.815 07:16:54 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:51.815 07:16:54 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:51.815 07:16:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:51.815 07:16:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:51.815 07:16:54 -- common/autotest_common.sh@10 -- # set +x 00:18:51.815 ************************************ 00:18:51.815 START TEST nvmf_fuzz 00:18:51.815 ************************************ 00:18:51.815 07:16:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:51.815 * Looking for test storage... 00:18:51.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:51.815 07:16:54 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:51.815 07:16:54 -- nvmf/common.sh@7 -- # uname -s 00:18:51.815 07:16:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:51.815 07:16:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:51.815 07:16:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:51.815 07:16:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:51.815 07:16:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:51.815 07:16:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:51.815 07:16:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:51.815 07:16:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:51.815 07:16:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:51.815 07:16:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:51.816 07:16:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.816 07:16:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.816 07:16:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:51.816 07:16:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:51.816 07:16:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:51.816 07:16:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:51.816 07:16:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:51.816 07:16:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:51.816 07:16:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:51.816 07:16:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.816 07:16:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.816 07:16:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.816 07:16:54 -- paths/export.sh@5 -- # export PATH 00:18:51.816 07:16:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.816 07:16:54 -- nvmf/common.sh@46 -- # : 0 00:18:51.816 07:16:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:51.816 07:16:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:51.816 07:16:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:51.816 07:16:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:51.816 07:16:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:51.816 07:16:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:51.816 07:16:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:51.816 07:16:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:51.816 07:16:54 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:51.816 07:16:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:51.816 07:16:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:51.816 07:16:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:51.816 07:16:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:51.816 07:16:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:51.816 07:16:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.816 07:16:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.816 07:16:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.816 07:16:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:51.816 07:16:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:51.816 07:16:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:51.816 07:16:54 -- common/autotest_common.sh@10 -- # set +x 00:18:53.716 07:16:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:53.716 07:16:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:53.716 07:16:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:53.716 07:16:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:53.716 07:16:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:53.716 07:16:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:53.716 07:16:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:53.716 07:16:56 -- nvmf/common.sh@294 -- # net_devs=() 00:18:53.716 07:16:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:53.716 07:16:56 -- nvmf/common.sh@295 -- # e810=() 00:18:53.716 07:16:56 -- nvmf/common.sh@295 -- # local -ga e810 00:18:53.716 07:16:56 -- nvmf/common.sh@296 -- # x722=() 00:18:53.717 07:16:56 -- nvmf/common.sh@296 -- # local -ga x722 00:18:53.717 07:16:56 -- nvmf/common.sh@297 -- # mlx=() 00:18:53.717 07:16:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:53.717 07:16:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:53.717 07:16:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.717 07:16:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:53.717 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:53.717 07:16:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.717 07:16:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:53.717 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:53.717 07:16:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.717 07:16:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.717 07:16:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.717 07:16:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:53.717 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:53.717 07:16:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.717 07:16:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.717 07:16:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.717 07:16:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:53.717 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:53.717 07:16:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:53.717 07:16:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:53.717 07:16:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:53.717 07:16:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:53.717 07:16:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:53.717 07:16:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:53.717 07:16:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:53.717 07:16:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:53.717 07:16:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:53.717 07:16:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:53.717 07:16:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:53.717 07:16:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:53.717 07:16:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:53.717 07:16:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:53.717 07:16:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:53.717 07:16:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:53.717 07:16:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:53.717 07:16:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:53.717 07:16:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:53.717 07:16:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:53.717 07:16:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:53.717 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:53.717 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:18:53.717 00:18:53.717 --- 10.0.0.2 ping statistics --- 00:18:53.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.717 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:18:53.717 07:16:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:53.717 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:53.717 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:18:53.717 00:18:53.717 --- 10.0.0.1 ping statistics --- 00:18:53.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.717 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:18:53.717 07:16:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:53.717 07:16:56 -- nvmf/common.sh@410 -- # return 0 00:18:53.717 07:16:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:53.717 07:16:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:53.717 07:16:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:53.717 07:16:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:53.717 07:16:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:53.717 07:16:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:53.717 07:16:56 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1932229 00:18:53.717 07:16:56 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:53.717 07:16:56 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:53.717 07:16:56 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1932229 00:18:53.717 07:16:56 -- common/autotest_common.sh@819 -- # '[' -z 1932229 ']' 00:18:53.717 07:16:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:53.717 07:16:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:53.717 07:16:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:53.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:53.717 07:16:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:53.717 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:53.976 07:16:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:53.976 07:16:56 -- common/autotest_common.sh@852 -- # return 0 00:18:53.976 07:16:56 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:53.976 07:16:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:53.976 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:53.976 07:16:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:53.976 07:16:56 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:53.976 07:16:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:53.976 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:54.235 Malloc0 00:18:54.235 07:16:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.235 07:16:56 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:54.235 07:16:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.235 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:54.235 07:16:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.235 07:16:56 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:54.235 07:16:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.235 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:54.235 07:16:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.235 07:16:56 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:54.235 07:16:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.235 07:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:54.235 07:16:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.235 07:16:56 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:54.235 07:16:56 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:26.297 Fuzzing completed. Shutting down the fuzz application 00:19:26.297 00:19:26.297 Dumping successful admin opcodes: 00:19:26.297 8, 9, 10, 24, 00:19:26.297 Dumping successful io opcodes: 00:19:26.297 0, 9, 00:19:26.297 NS: 0x200003aeff00 I/O qp, Total commands completed: 479486, total successful commands: 2774, random_seed: 3825358272 00:19:26.297 NS: 0x200003aeff00 admin qp, Total commands completed: 57824, total successful commands: 462, random_seed: 2030244416 00:19:26.297 07:17:27 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:26.297 Fuzzing completed. Shutting down the fuzz application 00:19:26.297 00:19:26.297 Dumping successful admin opcodes: 00:19:26.297 24, 00:19:26.297 Dumping successful io opcodes: 00:19:26.297 00:19:26.297 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 447059598 00:19:26.297 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 447197982 00:19:26.297 07:17:28 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:26.297 07:17:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:26.297 07:17:28 -- common/autotest_common.sh@10 -- # set +x 00:19:26.297 07:17:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:26.297 07:17:28 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:26.297 07:17:28 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:26.297 07:17:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:26.297 07:17:28 -- nvmf/common.sh@116 -- # sync 00:19:26.297 07:17:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:26.297 07:17:28 -- nvmf/common.sh@119 -- # set +e 00:19:26.297 07:17:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:26.297 07:17:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:26.297 rmmod nvme_tcp 00:19:26.297 rmmod nvme_fabrics 00:19:26.297 rmmod nvme_keyring 00:19:26.297 07:17:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:26.297 07:17:28 -- nvmf/common.sh@123 -- # set -e 00:19:26.297 07:17:28 -- nvmf/common.sh@124 -- # return 0 00:19:26.297 07:17:28 -- nvmf/common.sh@477 -- # '[' -n 1932229 ']' 00:19:26.297 07:17:28 -- nvmf/common.sh@478 -- # killprocess 1932229 00:19:26.297 07:17:28 -- common/autotest_common.sh@926 -- # '[' -z 1932229 ']' 00:19:26.297 07:17:28 -- common/autotest_common.sh@930 -- # kill -0 1932229 00:19:26.297 07:17:28 -- common/autotest_common.sh@931 -- # uname 00:19:26.297 07:17:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:26.297 07:17:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1932229 00:19:26.298 07:17:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:26.298 07:17:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:26.298 07:17:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1932229' 00:19:26.298 killing process with pid 1932229 00:19:26.298 07:17:28 -- common/autotest_common.sh@945 -- # kill 1932229 00:19:26.298 07:17:28 -- common/autotest_common.sh@950 -- # wait 1932229 00:19:26.556 07:17:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:26.556 07:17:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:26.556 07:17:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:26.556 07:17:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:26.556 07:17:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:26.556 07:17:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.556 07:17:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.556 07:17:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.457 07:17:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:28.457 07:17:31 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:28.457 00:19:28.457 real 0m37.144s 00:19:28.457 user 0m51.841s 00:19:28.457 sys 0m14.464s 00:19:28.457 07:17:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:28.457 07:17:31 -- common/autotest_common.sh@10 -- # set +x 00:19:28.457 ************************************ 00:19:28.457 END TEST nvmf_fuzz 00:19:28.457 ************************************ 00:19:28.457 07:17:31 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:28.458 07:17:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:28.458 07:17:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:28.458 07:17:31 -- common/autotest_common.sh@10 -- # set +x 00:19:28.458 ************************************ 00:19:28.458 START TEST nvmf_multiconnection 00:19:28.458 ************************************ 00:19:28.458 07:17:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:28.717 * Looking for test storage... 00:19:28.717 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:28.717 07:17:31 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:28.717 07:17:31 -- nvmf/common.sh@7 -- # uname -s 00:19:28.717 07:17:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:28.717 07:17:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:28.717 07:17:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:28.717 07:17:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:28.717 07:17:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:28.717 07:17:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:28.717 07:17:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:28.717 07:17:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:28.717 07:17:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:28.717 07:17:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:28.717 07:17:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.717 07:17:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.717 07:17:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:28.717 07:17:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:28.717 07:17:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:28.717 07:17:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:28.717 07:17:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:28.717 07:17:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:28.717 07:17:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:28.717 07:17:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.717 07:17:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.717 07:17:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.717 07:17:31 -- paths/export.sh@5 -- # export PATH 00:19:28.717 07:17:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.717 07:17:31 -- nvmf/common.sh@46 -- # : 0 00:19:28.717 07:17:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:28.717 07:17:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:28.717 07:17:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:28.717 07:17:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:28.717 07:17:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:28.717 07:17:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:28.717 07:17:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:28.717 07:17:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:28.717 07:17:31 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:28.717 07:17:31 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:28.717 07:17:31 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:28.717 07:17:31 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:28.717 07:17:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:28.717 07:17:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:28.717 07:17:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:28.717 07:17:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:28.717 07:17:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:28.717 07:17:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:28.717 07:17:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:28.717 07:17:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.717 07:17:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:28.717 07:17:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:28.717 07:17:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:28.717 07:17:31 -- common/autotest_common.sh@10 -- # set +x 00:19:30.621 07:17:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:30.621 07:17:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:30.621 07:17:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:30.621 07:17:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:30.621 07:17:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:30.621 07:17:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:30.621 07:17:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:30.621 07:17:33 -- nvmf/common.sh@294 -- # net_devs=() 00:19:30.621 07:17:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:30.621 07:17:33 -- nvmf/common.sh@295 -- # e810=() 00:19:30.621 07:17:33 -- nvmf/common.sh@295 -- # local -ga e810 00:19:30.621 07:17:33 -- nvmf/common.sh@296 -- # x722=() 00:19:30.621 07:17:33 -- nvmf/common.sh@296 -- # local -ga x722 00:19:30.621 07:17:33 -- nvmf/common.sh@297 -- # mlx=() 00:19:30.621 07:17:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:30.621 07:17:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:30.621 07:17:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:30.621 07:17:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:30.621 07:17:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.621 07:17:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:30.621 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:30.621 07:17:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:30.621 07:17:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:30.621 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:30.621 07:17:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.621 07:17:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.621 07:17:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.621 07:17:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:30.621 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:30.621 07:17:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.621 07:17:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:30.621 07:17:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.621 07:17:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.621 07:17:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:30.621 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:30.621 07:17:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.621 07:17:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:30.621 07:17:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:30.621 07:17:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:30.621 07:17:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:30.621 07:17:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:30.621 07:17:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:30.621 07:17:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:30.621 07:17:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:30.621 07:17:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:30.621 07:17:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:30.621 07:17:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:30.621 07:17:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:30.621 07:17:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:30.621 07:17:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:30.621 07:17:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:30.621 07:17:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:30.621 07:17:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:30.880 07:17:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:30.880 07:17:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:30.880 07:17:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:30.880 07:17:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:30.880 07:17:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:30.880 07:17:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:30.880 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:30.880 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:19:30.880 00:19:30.880 --- 10.0.0.2 ping statistics --- 00:19:30.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.880 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:19:30.880 07:17:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:30.880 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:30.880 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:19:30.880 00:19:30.880 --- 10.0.0.1 ping statistics --- 00:19:30.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:30.880 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:19:30.880 07:17:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:30.880 07:17:33 -- nvmf/common.sh@410 -- # return 0 00:19:30.880 07:17:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:30.880 07:17:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:30.880 07:17:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:30.880 07:17:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:30.880 07:17:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:30.880 07:17:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:30.880 07:17:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:30.880 07:17:33 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:30.880 07:17:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:30.880 07:17:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:30.880 07:17:33 -- common/autotest_common.sh@10 -- # set +x 00:19:30.880 07:17:33 -- nvmf/common.sh@469 -- # nvmfpid=1938084 00:19:30.880 07:17:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:30.880 07:17:33 -- nvmf/common.sh@470 -- # waitforlisten 1938084 00:19:30.880 07:17:33 -- common/autotest_common.sh@819 -- # '[' -z 1938084 ']' 00:19:30.880 07:17:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:30.880 07:17:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:30.880 07:17:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:30.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:30.880 07:17:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:30.880 07:17:33 -- common/autotest_common.sh@10 -- # set +x 00:19:30.880 [2024-10-16 07:17:33.696353] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:30.880 [2024-10-16 07:17:33.696437] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:30.880 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.880 [2024-10-16 07:17:33.763620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:31.138 [2024-10-16 07:17:33.885426] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:31.138 [2024-10-16 07:17:33.885578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:31.138 [2024-10-16 07:17:33.885598] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:31.138 [2024-10-16 07:17:33.885612] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:31.138 [2024-10-16 07:17:33.885697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:31.138 [2024-10-16 07:17:33.885751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:31.138 [2024-10-16 07:17:33.885782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:31.138 [2024-10-16 07:17:33.885785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:32.073 07:17:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:32.073 07:17:34 -- common/autotest_common.sh@852 -- # return 0 00:19:32.073 07:17:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:32.073 07:17:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:32.073 07:17:34 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 [2024-10-16 07:17:34.675208] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:32.073 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.073 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 Malloc1 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 [2024-10-16 07:17:34.732308] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.073 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 Malloc2 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.073 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:32.073 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.073 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.073 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.074 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 Malloc3 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.074 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 Malloc4 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.074 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 Malloc5 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.074 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 Malloc6 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:34 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.074 07:17:34 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:32.074 07:17:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 Malloc7 00:19:32.074 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:35 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:32.074 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.074 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.074 07:17:35 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:32.074 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.074 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.332 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.332 07:17:35 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:32.332 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.332 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.332 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.332 07:17:35 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.332 07:17:35 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 Malloc8 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.333 07:17:35 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 Malloc9 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.333 07:17:35 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 Malloc10 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.333 07:17:35 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 Malloc11 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:32.333 07:17:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.333 07:17:35 -- common/autotest_common.sh@10 -- # set +x 00:19:32.333 07:17:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.333 07:17:35 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:32.333 07:17:35 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.333 07:17:35 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:33.264 07:17:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:33.264 07:17:35 -- common/autotest_common.sh@1177 -- # local i=0 00:19:33.264 07:17:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:33.264 07:17:35 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:33.264 07:17:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:35.160 07:17:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:35.160 07:17:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:35.160 07:17:37 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:19:35.160 07:17:37 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:35.161 07:17:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.161 07:17:37 -- common/autotest_common.sh@1187 -- # return 0 00:19:35.161 07:17:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.161 07:17:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:35.726 07:17:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:35.726 07:17:38 -- common/autotest_common.sh@1177 -- # local i=0 00:19:35.726 07:17:38 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.726 07:17:38 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:35.726 07:17:38 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:37.689 07:17:40 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:37.689 07:17:40 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:37.689 07:17:40 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:19:37.689 07:17:40 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:37.689 07:17:40 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.689 07:17:40 -- common/autotest_common.sh@1187 -- # return 0 00:19:37.689 07:17:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.689 07:17:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:38.275 07:17:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:38.275 07:17:41 -- common/autotest_common.sh@1177 -- # local i=0 00:19:38.276 07:17:41 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.276 07:17:41 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:38.276 07:17:41 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:40.802 07:17:43 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:40.802 07:17:43 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:40.802 07:17:43 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:19:40.802 07:17:43 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:40.802 07:17:43 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.802 07:17:43 -- common/autotest_common.sh@1187 -- # return 0 00:19:40.802 07:17:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.802 07:17:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:41.059 07:17:43 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:41.060 07:17:43 -- common/autotest_common.sh@1177 -- # local i=0 00:19:41.060 07:17:43 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.060 07:17:43 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:41.060 07:17:43 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:42.960 07:17:45 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:42.960 07:17:45 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:42.960 07:17:45 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:19:42.960 07:17:45 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:42.960 07:17:45 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.960 07:17:45 -- common/autotest_common.sh@1187 -- # return 0 00:19:42.960 07:17:45 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.960 07:17:45 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:43.893 07:17:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:43.893 07:17:46 -- common/autotest_common.sh@1177 -- # local i=0 00:19:43.893 07:17:46 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.893 07:17:46 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:43.893 07:17:46 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:45.806 07:17:48 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:45.806 07:17:48 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:45.806 07:17:48 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:19:45.806 07:17:48 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:45.806 07:17:48 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.806 07:17:48 -- common/autotest_common.sh@1187 -- # return 0 00:19:45.806 07:17:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.806 07:17:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:46.372 07:17:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:46.372 07:17:49 -- common/autotest_common.sh@1177 -- # local i=0 00:19:46.372 07:17:49 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.372 07:17:49 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:46.372 07:17:49 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:48.900 07:17:51 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:48.900 07:17:51 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:48.900 07:17:51 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:19:48.900 07:17:51 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:48.900 07:17:51 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.900 07:17:51 -- common/autotest_common.sh@1187 -- # return 0 00:19:48.900 07:17:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.900 07:17:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:49.465 07:17:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:49.465 07:17:52 -- common/autotest_common.sh@1177 -- # local i=0 00:19:49.465 07:17:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.465 07:17:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:49.465 07:17:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:51.363 07:17:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:51.363 07:17:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:51.363 07:17:54 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:19:51.363 07:17:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:51.363 07:17:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.363 07:17:54 -- common/autotest_common.sh@1187 -- # return 0 00:19:51.363 07:17:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.363 07:17:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:52.295 07:17:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:52.295 07:17:54 -- common/autotest_common.sh@1177 -- # local i=0 00:19:52.295 07:17:54 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.295 07:17:54 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:52.295 07:17:54 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:54.193 07:17:56 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:54.193 07:17:56 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:54.193 07:17:56 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:19:54.193 07:17:56 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:54.193 07:17:56 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.193 07:17:56 -- common/autotest_common.sh@1187 -- # return 0 00:19:54.193 07:17:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.193 07:17:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:55.128 07:17:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:55.128 07:17:57 -- common/autotest_common.sh@1177 -- # local i=0 00:19:55.128 07:17:57 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.128 07:17:57 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:55.128 07:17:57 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:57.025 07:17:59 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:57.025 07:17:59 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:57.025 07:17:59 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:19:57.025 07:17:59 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:57.025 07:17:59 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.025 07:17:59 -- common/autotest_common.sh@1187 -- # return 0 00:19:57.025 07:17:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.025 07:17:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:57.957 07:18:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:57.957 07:18:00 -- common/autotest_common.sh@1177 -- # local i=0 00:19:57.957 07:18:00 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:57.957 07:18:00 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:57.957 07:18:00 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:59.855 07:18:02 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:59.855 07:18:02 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:59.855 07:18:02 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:19:59.855 07:18:02 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:59.855 07:18:02 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:59.855 07:18:02 -- common/autotest_common.sh@1187 -- # return 0 00:19:59.855 07:18:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:59.855 07:18:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:01.228 07:18:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:01.228 07:18:03 -- common/autotest_common.sh@1177 -- # local i=0 00:20:01.228 07:18:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.228 07:18:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:01.228 07:18:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:03.127 07:18:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:03.127 07:18:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:03.127 07:18:05 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:20:03.127 07:18:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:03.127 07:18:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:03.127 07:18:05 -- common/autotest_common.sh@1187 -- # return 0 00:20:03.127 07:18:05 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:03.127 [global] 00:20:03.127 thread=1 00:20:03.127 invalidate=1 00:20:03.127 rw=read 00:20:03.127 time_based=1 00:20:03.127 runtime=10 00:20:03.127 ioengine=libaio 00:20:03.127 direct=1 00:20:03.127 bs=262144 00:20:03.127 iodepth=64 00:20:03.127 norandommap=1 00:20:03.127 numjobs=1 00:20:03.127 00:20:03.127 [job0] 00:20:03.127 filename=/dev/nvme0n1 00:20:03.127 [job1] 00:20:03.127 filename=/dev/nvme10n1 00:20:03.127 [job2] 00:20:03.127 filename=/dev/nvme1n1 00:20:03.127 [job3] 00:20:03.127 filename=/dev/nvme2n1 00:20:03.127 [job4] 00:20:03.127 filename=/dev/nvme3n1 00:20:03.127 [job5] 00:20:03.127 filename=/dev/nvme4n1 00:20:03.127 [job6] 00:20:03.127 filename=/dev/nvme5n1 00:20:03.127 [job7] 00:20:03.127 filename=/dev/nvme6n1 00:20:03.127 [job8] 00:20:03.127 filename=/dev/nvme7n1 00:20:03.127 [job9] 00:20:03.127 filename=/dev/nvme8n1 00:20:03.127 [job10] 00:20:03.127 filename=/dev/nvme9n1 00:20:03.127 Could not set queue depth (nvme0n1) 00:20:03.127 Could not set queue depth (nvme10n1) 00:20:03.127 Could not set queue depth (nvme1n1) 00:20:03.127 Could not set queue depth (nvme2n1) 00:20:03.127 Could not set queue depth (nvme3n1) 00:20:03.127 Could not set queue depth (nvme4n1) 00:20:03.127 Could not set queue depth (nvme5n1) 00:20:03.127 Could not set queue depth (nvme6n1) 00:20:03.127 Could not set queue depth (nvme7n1) 00:20:03.127 Could not set queue depth (nvme8n1) 00:20:03.127 Could not set queue depth (nvme9n1) 00:20:03.385 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:03.385 fio-3.35 00:20:03.385 Starting 11 threads 00:20:15.587 00:20:15.587 job0: (groupid=0, jobs=1): err= 0: pid=1942713: Wed Oct 16 07:18:16 2024 00:20:15.587 read: IOPS=622, BW=156MiB/s (163MB/s)(1566MiB/10063msec) 00:20:15.587 slat (usec): min=9, max=153287, avg=1111.89, stdev=6137.59 00:20:15.587 clat (usec): min=629, max=366272, avg=101660.64, stdev=66712.23 00:20:15.587 lat (usec): min=653, max=373384, avg=102772.53, stdev=67988.16 00:20:15.587 clat percentiles (msec): 00:20:15.587 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 25], 20.00th=[ 41], 00:20:15.587 | 30.00th=[ 56], 40.00th=[ 67], 50.00th=[ 82], 60.00th=[ 109], 00:20:15.587 | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 194], 95.00th=[ 211], 00:20:15.587 | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 313], 00:20:15.587 | 99.99th=[ 368] 00:20:15.587 bw ( KiB/s): min=63872, max=337920, per=8.61%, avg=158644.45, stdev=82598.53, samples=20 00:20:15.587 iops : min= 249, max= 1320, avg=619.65, stdev=322.71, samples=20 00:20:15.587 lat (usec) : 750=0.02%, 1000=0.06% 00:20:15.587 lat (msec) : 2=0.16%, 4=0.22%, 10=2.36%, 20=4.63%, 50=19.24% 00:20:15.587 lat (msec) : 100=31.16%, 250=41.01%, 500=1.13% 00:20:15.587 cpu : usr=0.27%, sys=1.77%, ctx=1313, majf=0, minf=4097 00:20:15.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.587 issued rwts: total=6262,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.587 job1: (groupid=0, jobs=1): err= 0: pid=1942715: Wed Oct 16 07:18:16 2024 00:20:15.587 read: IOPS=377, BW=94.5MiB/s (99.0MB/s)(954MiB/10103msec) 00:20:15.587 slat (usec): min=11, max=105954, avg=2449.14, stdev=6987.97 00:20:15.587 clat (usec): min=1231, max=348257, avg=166822.55, stdev=53597.34 00:20:15.587 lat (usec): min=1251, max=359033, avg=169271.69, stdev=54565.79 00:20:15.587 clat percentiles (msec): 00:20:15.587 | 1.00th=[ 6], 5.00th=[ 90], 10.00th=[ 107], 20.00th=[ 126], 00:20:15.587 | 30.00th=[ 142], 40.00th=[ 159], 50.00th=[ 174], 60.00th=[ 184], 00:20:15.587 | 70.00th=[ 197], 80.00th=[ 205], 90.00th=[ 224], 95.00th=[ 247], 00:20:15.587 | 99.00th=[ 296], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 351], 00:20:15.587 | 99.99th=[ 351] 00:20:15.587 bw ( KiB/s): min=62339, max=145408, per=5.22%, avg=96078.20, stdev=23917.50, samples=20 00:20:15.587 iops : min= 243, max= 568, avg=375.25, stdev=93.48, samples=20 00:20:15.587 lat (msec) : 2=0.37%, 4=0.42%, 10=1.44%, 20=0.84%, 50=0.63% 00:20:15.587 lat (msec) : 100=4.77%, 250=87.14%, 500=4.40% 00:20:15.587 cpu : usr=0.26%, sys=1.37%, ctx=799, majf=0, minf=3721 00:20:15.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:20:15.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.587 issued rwts: total=3817,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.587 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.587 job2: (groupid=0, jobs=1): err= 0: pid=1942719: Wed Oct 16 07:18:16 2024 00:20:15.587 read: IOPS=707, BW=177MiB/s (185MB/s)(1771MiB/10017msec) 00:20:15.587 slat (usec): min=8, max=172315, avg=1235.64, stdev=4885.77 00:20:15.587 clat (usec): min=680, max=377439, avg=89190.39, stdev=66777.48 00:20:15.587 lat (usec): min=697, max=377510, avg=90426.03, stdev=67750.40 00:20:15.587 clat percentiles (usec): 00:20:15.587 | 1.00th=[ 1745], 5.00th=[ 6718], 10.00th=[ 12780], 20.00th=[ 31851], 00:20:15.587 | 30.00th=[ 49021], 40.00th=[ 57934], 50.00th=[ 67634], 60.00th=[ 80217], 00:20:15.587 | 70.00th=[106431], 80.00th=[166724], 90.00th=[191890], 95.00th=[206570], 00:20:15.587 | 99.00th=[270533], 99.50th=[278922], 99.90th=[304088], 99.95th=[312476], 00:20:15.587 | 99.99th=[375391] 00:20:15.587 bw ( KiB/s): min=86355, max=419328, per=9.76%, avg=179728.15, stdev=99192.84, samples=20 00:20:15.587 iops : min= 337, max= 1638, avg=701.95, stdev=387.48, samples=20 00:20:15.587 lat (usec) : 750=0.01%, 1000=0.23% 00:20:15.587 lat (msec) : 2=0.95%, 4=1.79%, 10=3.94%, 20=6.15%, 50=18.24% 00:20:15.587 lat (msec) : 100=37.40%, 250=29.70%, 500=1.59% 00:20:15.587 cpu : usr=0.42%, sys=2.08%, ctx=1400, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=7085,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job3: (groupid=0, jobs=1): err= 0: pid=1942720: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=1126, BW=282MiB/s (295MB/s)(2841MiB/10089msec) 00:20:15.588 slat (usec): min=9, max=47530, avg=765.79, stdev=2729.95 00:20:15.588 clat (usec): min=1024, max=216215, avg=56022.48, stdev=29288.49 00:20:15.588 lat (usec): min=1113, max=216346, avg=56788.27, stdev=29539.46 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 11], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], 00:20:15.588 | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 56], 00:20:15.588 | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 95], 95.00th=[ 110], 00:20:15.588 | 99.00th=[ 165], 99.50th=[ 178], 99.90th=[ 215], 99.95th=[ 215], 00:20:15.588 | 99.99th=[ 218] 00:20:15.588 bw ( KiB/s): min=112865, max=497181, per=15.70%, avg=289173.10, stdev=102560.32, samples=20 00:20:15.588 iops : min= 440, max= 1942, avg=1129.50, stdev=400.72, samples=20 00:20:15.588 lat (msec) : 2=0.03%, 4=0.04%, 10=0.81%, 20=1.52%, 50=50.05% 00:20:15.588 lat (msec) : 100=39.39%, 250=8.16% 00:20:15.588 cpu : usr=0.63%, sys=3.34%, ctx=1765, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=11362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job4: (groupid=0, jobs=1): err= 0: pid=1942722: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=644, BW=161MiB/s (169MB/s)(1626MiB/10094msec) 00:20:15.588 slat (usec): min=13, max=237255, avg=1398.76, stdev=7022.55 00:20:15.588 clat (msec): min=2, max=441, avg=97.87, stdev=69.37 00:20:15.588 lat (msec): min=2, max=441, avg=99.27, stdev=70.50 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 16], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 37], 00:20:15.588 | 30.00th=[ 45], 40.00th=[ 60], 50.00th=[ 75], 60.00th=[ 93], 00:20:15.588 | 70.00th=[ 123], 80.00th=[ 180], 90.00th=[ 203], 95.00th=[ 222], 00:20:15.588 | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 334], 00:20:15.588 | 99.99th=[ 443] 00:20:15.588 bw ( KiB/s): min=67072, max=381952, per=8.95%, avg=164863.20, stdev=99212.51, samples=20 00:20:15.588 iops : min= 262, max= 1492, avg=643.90, stdev=387.42, samples=20 00:20:15.588 lat (msec) : 4=0.03%, 10=0.69%, 20=0.62%, 50=33.42%, 100=27.73% 00:20:15.588 lat (msec) : 250=34.75%, 500=2.77% 00:20:15.588 cpu : usr=0.34%, sys=2.05%, ctx=1034, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=6503,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job5: (groupid=0, jobs=1): err= 0: pid=1942730: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=732, BW=183MiB/s (192MB/s)(1840MiB/10050msec) 00:20:15.588 slat (usec): min=8, max=145666, avg=869.37, stdev=5610.13 00:20:15.588 clat (usec): min=664, max=388249, avg=86447.68, stdev=73972.74 00:20:15.588 lat (usec): min=678, max=388283, avg=87317.05, stdev=75152.18 00:20:15.588 clat percentiles (usec): 00:20:15.588 | 1.00th=[ 1287], 5.00th=[ 5014], 10.00th=[ 8586], 20.00th=[ 17957], 00:20:15.588 | 30.00th=[ 35390], 40.00th=[ 49546], 50.00th=[ 61080], 60.00th=[ 79168], 00:20:15.588 | 70.00th=[111674], 80.00th=[170918], 90.00th=[202376], 95.00th=[221250], 00:20:15.588 | 99.00th=[274727], 99.50th=[278922], 99.90th=[308282], 99.95th=[316670], 00:20:15.588 | 99.99th=[387974] 00:20:15.588 bw ( KiB/s): min=62850, max=512000, per=10.14%, avg=186795.50, stdev=125153.83, samples=20 00:20:15.588 iops : min= 245, max= 2000, avg=729.60, stdev=488.88, samples=20 00:20:15.588 lat (usec) : 750=0.01%, 1000=0.43% 00:20:15.588 lat (msec) : 2=1.55%, 4=1.79%, 10=7.84%, 20=9.75%, 50=18.95% 00:20:15.588 lat (msec) : 100=27.39%, 250=29.89%, 500=2.39% 00:20:15.588 cpu : usr=0.32%, sys=1.81%, ctx=1594, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=7361,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job6: (groupid=0, jobs=1): err= 0: pid=1942731: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=503, BW=126MiB/s (132MB/s)(1260MiB/10017msec) 00:20:15.588 slat (usec): min=11, max=144469, avg=1788.48, stdev=6976.41 00:20:15.588 clat (usec): min=1917, max=377833, avg=125300.05, stdev=74661.31 00:20:15.588 lat (usec): min=1936, max=429685, avg=127088.52, stdev=75903.23 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 6], 5.00th=[ 22], 10.00th=[ 31], 20.00th=[ 51], 00:20:15.588 | 30.00th=[ 61], 40.00th=[ 91], 50.00th=[ 131], 60.00th=[ 157], 00:20:15.588 | 70.00th=[ 184], 80.00th=[ 199], 90.00th=[ 215], 95.00th=[ 236], 00:20:15.588 | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], 00:20:15.588 | 99.99th=[ 380] 00:20:15.588 bw ( KiB/s): min=68096, max=355328, per=6.92%, avg=127422.50, stdev=72031.28, samples=20 00:20:15.588 iops : min= 266, max= 1388, avg=497.65, stdev=281.40, samples=20 00:20:15.588 lat (msec) : 2=0.02%, 4=0.30%, 10=2.82%, 20=1.71%, 50=15.14% 00:20:15.588 lat (msec) : 100=21.17%, 250=55.39%, 500=3.47% 00:20:15.588 cpu : usr=0.28%, sys=1.90%, ctx=1062, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=5041,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job7: (groupid=0, jobs=1): err= 0: pid=1942732: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=896, BW=224MiB/s (235MB/s)(2255MiB/10063msec) 00:20:15.588 slat (usec): min=9, max=158695, avg=783.34, stdev=4222.63 00:20:15.588 clat (usec): min=1067, max=400708, avg=70586.99, stdev=60995.49 00:20:15.588 lat (usec): min=1111, max=400746, avg=71370.32, stdev=61703.39 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 18], 20.00th=[ 27], 00:20:15.588 | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 45], 60.00th=[ 64], 00:20:15.588 | 70.00th=[ 84], 80.00th=[ 117], 90.00th=[ 171], 95.00th=[ 194], 00:20:15.588 | 99.00th=[ 249], 99.50th=[ 313], 99.90th=[ 376], 99.95th=[ 380], 00:20:15.588 | 99.99th=[ 401] 00:20:15.588 bw ( KiB/s): min=71536, max=521728, per=12.45%, avg=229210.85, stdev=130166.34, samples=20 00:20:15.588 iops : min= 279, max= 2038, avg=895.25, stdev=508.46, samples=20 00:20:15.588 lat (msec) : 2=0.10%, 4=0.54%, 10=2.79%, 20=8.92%, 50=41.57% 00:20:15.588 lat (msec) : 100=22.31%, 250=22.84%, 500=0.92% 00:20:15.588 cpu : usr=0.41%, sys=2.31%, ctx=1602, majf=0, minf=4098 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=9018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job8: (groupid=0, jobs=1): err= 0: pid=1942735: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=462, BW=116MiB/s (121MB/s)(1167MiB/10089msec) 00:20:15.588 slat (usec): min=10, max=109427, avg=1513.16, stdev=6174.27 00:20:15.588 clat (usec): min=1867, max=324167, avg=136762.71, stdev=67923.96 00:20:15.588 lat (usec): min=1888, max=324186, avg=138275.88, stdev=69131.87 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 45], 20.00th=[ 70], 00:20:15.588 | 30.00th=[ 87], 40.00th=[ 111], 50.00th=[ 134], 60.00th=[ 169], 00:20:15.588 | 70.00th=[ 188], 80.00th=[ 201], 90.00th=[ 215], 95.00th=[ 239], 00:20:15.588 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], 00:20:15.588 | 99.99th=[ 326] 00:20:15.588 bw ( KiB/s): min=65024, max=231936, per=6.40%, avg=117824.85, stdev=50281.47, samples=20 00:20:15.588 iops : min= 254, max= 906, avg=460.15, stdev=196.46, samples=20 00:20:15.588 lat (msec) : 2=0.06%, 4=0.49%, 10=0.60%, 20=1.59%, 50=8.19% 00:20:15.588 lat (msec) : 100=23.72%, 250=61.53%, 500=3.81% 00:20:15.588 cpu : usr=0.22%, sys=1.48%, ctx=1109, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=4666,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job9: (groupid=0, jobs=1): err= 0: pid=1942736: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=787, BW=197MiB/s (207MB/s)(1988MiB/10096msec) 00:20:15.588 slat (usec): min=13, max=172373, avg=1199.88, stdev=4548.47 00:20:15.588 clat (usec): min=1743, max=384837, avg=79981.86, stdev=54847.03 00:20:15.588 lat (usec): min=1768, max=384854, avg=81181.74, stdev=55655.40 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 14], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 43], 00:20:15.588 | 30.00th=[ 53], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 73], 00:20:15.588 | 70.00th=[ 83], 80.00th=[ 95], 90.00th=[ 163], 95.00th=[ 209], 00:20:15.588 | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 384], 99.95th=[ 384], 00:20:15.588 | 99.99th=[ 384] 00:20:15.588 bw ( KiB/s): min=62589, max=397540, per=10.96%, avg=201908.65, stdev=95040.93, samples=20 00:20:15.588 iops : min= 244, max= 1552, avg=788.60, stdev=371.19, samples=20 00:20:15.588 lat (msec) : 2=0.01%, 4=0.31%, 10=0.44%, 20=1.04%, 50=25.41% 00:20:15.588 lat (msec) : 100=54.81%, 250=16.38%, 500=1.58% 00:20:15.588 cpu : usr=0.54%, sys=2.45%, ctx=1271, majf=0, minf=4097 00:20:15.588 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:15.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.588 issued rwts: total=7953,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.588 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.588 job10: (groupid=0, jobs=1): err= 0: pid=1942737: Wed Oct 16 07:18:16 2024 00:20:15.588 read: IOPS=357, BW=89.4MiB/s (93.7MB/s)(902MiB/10094msec) 00:20:15.588 slat (usec): min=13, max=75815, avg=2536.10, stdev=6820.88 00:20:15.588 clat (msec): min=47, max=312, avg=176.32, stdev=41.17 00:20:15.588 lat (msec): min=48, max=312, avg=178.86, stdev=41.72 00:20:15.588 clat percentiles (msec): 00:20:15.588 | 1.00th=[ 84], 5.00th=[ 114], 10.00th=[ 125], 20.00th=[ 138], 00:20:15.588 | 30.00th=[ 153], 40.00th=[ 169], 50.00th=[ 180], 60.00th=[ 190], 00:20:15.589 | 70.00th=[ 199], 80.00th=[ 207], 90.00th=[ 224], 95.00th=[ 249], 00:20:15.589 | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 309], 00:20:15.589 | 99.99th=[ 313] 00:20:15.589 bw ( KiB/s): min=63488, max=135680, per=4.93%, avg=90753.50, stdev=18391.92, samples=20 00:20:15.589 iops : min= 248, max= 530, avg=354.45, stdev=71.88, samples=20 00:20:15.589 lat (msec) : 50=0.72%, 100=1.69%, 250=92.96%, 500=4.63% 00:20:15.589 cpu : usr=0.22%, sys=1.33%, ctx=760, majf=0, minf=4097 00:20:15.589 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:15.589 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.589 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.589 issued rwts: total=3609,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.589 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.589 00:20:15.589 Run status group 0 (all jobs): 00:20:15.589 READ: bw=1798MiB/s (1886MB/s), 89.4MiB/s-282MiB/s (93.7MB/s-295MB/s), io=17.7GiB (19.1GB), run=10017-10103msec 00:20:15.589 00:20:15.589 Disk stats (read/write): 00:20:15.589 nvme0n1: ios=12314/0, merge=0/0, ticks=1235990/0, in_queue=1235990, util=97.19% 00:20:15.589 nvme10n1: ios=7448/0, merge=0/0, ticks=1225133/0, in_queue=1225133, util=97.40% 00:20:15.589 nvme1n1: ios=13895/0, merge=0/0, ticks=1238718/0, in_queue=1238718, util=97.66% 00:20:15.589 nvme2n1: ios=22433/0, merge=0/0, ticks=1241610/0, in_queue=1241610, util=97.80% 00:20:15.589 nvme3n1: ios=12798/0, merge=0/0, ticks=1231536/0, in_queue=1231536, util=97.87% 00:20:15.589 nvme4n1: ios=14400/0, merge=0/0, ticks=1233166/0, in_queue=1233166, util=98.24% 00:20:15.589 nvme5n1: ios=9833/0, merge=0/0, ticks=1233315/0, in_queue=1233315, util=98.41% 00:20:15.589 nvme6n1: ios=17845/0, merge=0/0, ticks=1235791/0, in_queue=1235791, util=98.50% 00:20:15.589 nvme7n1: ios=9142/0, merge=0/0, ticks=1234190/0, in_queue=1234190, util=98.90% 00:20:15.589 nvme8n1: ios=15713/0, merge=0/0, ticks=1232550/0, in_queue=1232550, util=99.10% 00:20:15.589 nvme9n1: ios=7046/0, merge=0/0, ticks=1228474/0, in_queue=1228474, util=99.24% 00:20:15.589 07:18:16 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:15.589 [global] 00:20:15.589 thread=1 00:20:15.589 invalidate=1 00:20:15.589 rw=randwrite 00:20:15.589 time_based=1 00:20:15.589 runtime=10 00:20:15.589 ioengine=libaio 00:20:15.589 direct=1 00:20:15.589 bs=262144 00:20:15.589 iodepth=64 00:20:15.589 norandommap=1 00:20:15.589 numjobs=1 00:20:15.589 00:20:15.589 [job0] 00:20:15.589 filename=/dev/nvme0n1 00:20:15.589 [job1] 00:20:15.589 filename=/dev/nvme10n1 00:20:15.589 [job2] 00:20:15.589 filename=/dev/nvme1n1 00:20:15.589 [job3] 00:20:15.589 filename=/dev/nvme2n1 00:20:15.589 [job4] 00:20:15.589 filename=/dev/nvme3n1 00:20:15.589 [job5] 00:20:15.589 filename=/dev/nvme4n1 00:20:15.589 [job6] 00:20:15.589 filename=/dev/nvme5n1 00:20:15.589 [job7] 00:20:15.589 filename=/dev/nvme6n1 00:20:15.589 [job8] 00:20:15.589 filename=/dev/nvme7n1 00:20:15.589 [job9] 00:20:15.589 filename=/dev/nvme8n1 00:20:15.589 [job10] 00:20:15.589 filename=/dev/nvme9n1 00:20:15.589 Could not set queue depth (nvme0n1) 00:20:15.589 Could not set queue depth (nvme10n1) 00:20:15.589 Could not set queue depth (nvme1n1) 00:20:15.589 Could not set queue depth (nvme2n1) 00:20:15.589 Could not set queue depth (nvme3n1) 00:20:15.589 Could not set queue depth (nvme4n1) 00:20:15.589 Could not set queue depth (nvme5n1) 00:20:15.589 Could not set queue depth (nvme6n1) 00:20:15.589 Could not set queue depth (nvme7n1) 00:20:15.589 Could not set queue depth (nvme8n1) 00:20:15.589 Could not set queue depth (nvme9n1) 00:20:15.589 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:15.589 fio-3.35 00:20:15.589 Starting 11 threads 00:20:25.561 00:20:25.561 job0: (groupid=0, jobs=1): err= 0: pid=1944373: Wed Oct 16 07:18:27 2024 00:20:25.561 write: IOPS=527, BW=132MiB/s (138MB/s)(1339MiB/10150msec); 0 zone resets 00:20:25.561 slat (usec): min=24, max=97310, avg=1461.93, stdev=4185.42 00:20:25.561 clat (msec): min=3, max=354, avg=119.72, stdev=69.77 00:20:25.561 lat (msec): min=3, max=354, avg=121.18, stdev=70.66 00:20:25.561 clat percentiles (msec): 00:20:25.561 | 1.00th=[ 12], 5.00th=[ 21], 10.00th=[ 36], 20.00th=[ 59], 00:20:25.561 | 30.00th=[ 71], 40.00th=[ 86], 50.00th=[ 113], 60.00th=[ 136], 00:20:25.561 | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 253], 00:20:25.561 | 99.00th=[ 305], 99.50th=[ 317], 99.90th=[ 342], 99.95th=[ 351], 00:20:25.561 | 99.99th=[ 355] 00:20:25.561 bw ( KiB/s): min=57229, max=245248, per=8.60%, avg=135427.95, stdev=54109.52, samples=20 00:20:25.561 iops : min= 223, max= 958, avg=528.90, stdev=211.38, samples=20 00:20:25.561 lat (msec) : 4=0.04%, 10=0.77%, 20=3.86%, 50=10.18%, 100=31.01% 00:20:25.561 lat (msec) : 250=48.15%, 500=5.99% 00:20:25.561 cpu : usr=1.74%, sys=1.95%, ctx=2665, majf=0, minf=1 00:20:25.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:25.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.561 issued rwts: total=0,5356,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.561 job1: (groupid=0, jobs=1): err= 0: pid=1944407: Wed Oct 16 07:18:27 2024 00:20:25.561 write: IOPS=431, BW=108MiB/s (113MB/s)(1093MiB/10129msec); 0 zone resets 00:20:25.561 slat (usec): min=20, max=75383, avg=1716.44, stdev=4443.78 00:20:25.562 clat (usec): min=1071, max=313432, avg=146480.21, stdev=59299.33 00:20:25.562 lat (usec): min=1111, max=313488, avg=148196.65, stdev=60093.36 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 8], 5.00th=[ 45], 10.00th=[ 85], 20.00th=[ 103], 00:20:25.562 | 30.00th=[ 114], 40.00th=[ 126], 50.00th=[ 142], 60.00th=[ 157], 00:20:25.562 | 70.00th=[ 176], 80.00th=[ 192], 90.00th=[ 224], 95.00th=[ 259], 00:20:25.562 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 313], 00:20:25.562 | 99.99th=[ 313] 00:20:25.562 bw ( KiB/s): min=61317, max=171520, per=7.00%, avg=110247.65, stdev=31369.02, samples=20 00:20:25.562 iops : min= 239, max= 670, avg=430.55, stdev=122.68, samples=20 00:20:25.562 lat (msec) : 2=0.05%, 4=0.37%, 10=0.98%, 20=0.94%, 50=3.45% 00:20:25.562 lat (msec) : 100=12.45%, 250=75.13%, 500=6.63% 00:20:25.562 cpu : usr=1.16%, sys=1.37%, ctx=2145, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,4371,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job2: (groupid=0, jobs=1): err= 0: pid=1944442: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=564, BW=141MiB/s (148MB/s)(1428MiB/10114msec); 0 zone resets 00:20:25.562 slat (usec): min=17, max=102529, avg=1229.37, stdev=4146.44 00:20:25.562 clat (usec): min=931, max=299017, avg=112047.88, stdev=73715.82 00:20:25.562 lat (usec): min=967, max=299106, avg=113277.25, stdev=74671.80 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 22], 20.00th=[ 41], 00:20:25.562 | 30.00th=[ 61], 40.00th=[ 89], 50.00th=[ 107], 60.00th=[ 121], 00:20:25.562 | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 226], 95.00th=[ 262], 00:20:25.562 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], 00:20:25.562 | 99.99th=[ 300] 00:20:25.562 bw ( KiB/s): min=57229, max=284103, per=9.18%, avg=144501.90, stdev=58402.57, samples=20 00:20:25.562 iops : min= 223, max= 1109, avg=564.35, stdev=228.14, samples=20 00:20:25.562 lat (usec) : 1000=0.02% 00:20:25.562 lat (msec) : 2=0.18%, 4=0.54%, 10=2.71%, 20=5.53%, 50=17.15% 00:20:25.562 lat (msec) : 100=20.12%, 250=47.48%, 500=6.27% 00:20:25.562 cpu : usr=1.92%, sys=2.08%, ctx=3250, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,5710,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job3: (groupid=0, jobs=1): err= 0: pid=1944455: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=731, BW=183MiB/s (192MB/s)(1854MiB/10130msec); 0 zone resets 00:20:25.562 slat (usec): min=16, max=39199, avg=1109.12, stdev=2579.02 00:20:25.562 clat (msec): min=2, max=272, avg=86.29, stdev=49.48 00:20:25.562 lat (msec): min=4, max=272, avg=87.40, stdev=50.04 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 30], 5.00th=[ 39], 10.00th=[ 40], 20.00th=[ 41], 00:20:25.562 | 30.00th=[ 43], 40.00th=[ 58], 50.00th=[ 75], 60.00th=[ 92], 00:20:25.562 | 70.00th=[ 112], 80.00th=[ 121], 90.00th=[ 157], 95.00th=[ 197], 00:20:25.562 | 99.00th=[ 222], 99.50th=[ 230], 99.90th=[ 255], 99.95th=[ 264], 00:20:25.562 | 99.99th=[ 275] 00:20:25.562 bw ( KiB/s): min=75776, max=382211, per=11.95%, avg=188108.00, stdev=93415.13, samples=20 00:20:25.562 iops : min= 296, max= 1493, avg=734.75, stdev=364.93, samples=20 00:20:25.562 lat (msec) : 4=0.01%, 10=0.09%, 20=0.26%, 50=36.14%, 100=25.52% 00:20:25.562 lat (msec) : 250=37.84%, 500=0.13% 00:20:25.562 cpu : usr=2.43%, sys=2.26%, ctx=2730, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,7415,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job4: (groupid=0, jobs=1): err= 0: pid=1944456: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=484, BW=121MiB/s (127MB/s)(1226MiB/10130msec); 0 zone resets 00:20:25.562 slat (usec): min=23, max=53876, avg=1454.55, stdev=3773.87 00:20:25.562 clat (msec): min=2, max=290, avg=130.65, stdev=60.86 00:20:25.562 lat (msec): min=3, max=294, avg=132.11, stdev=61.81 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 11], 5.00th=[ 27], 10.00th=[ 43], 20.00th=[ 82], 00:20:25.562 | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 126], 60.00th=[ 146], 00:20:25.562 | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 213], 95.00th=[ 245], 00:20:25.562 | 99.00th=[ 275], 99.50th=[ 279], 99.90th=[ 288], 99.95th=[ 288], 00:20:25.562 | 99.99th=[ 292] 00:20:25.562 bw ( KiB/s): min=61317, max=207360, per=7.87%, avg=123905.35, stdev=39152.77, samples=20 00:20:25.562 iops : min= 239, max= 810, avg=483.90, stdev=153.00, samples=20 00:20:25.562 lat (msec) : 4=0.06%, 10=0.71%, 20=2.34%, 50=8.71%, 100=14.72% 00:20:25.562 lat (msec) : 250=69.13%, 500=4.32% 00:20:25.562 cpu : usr=1.46%, sys=1.60%, ctx=2663, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,4905,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job5: (groupid=0, jobs=1): err= 0: pid=1944457: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=493, BW=123MiB/s (129MB/s)(1252MiB/10150msec); 0 zone resets 00:20:25.562 slat (usec): min=18, max=127203, avg=1747.48, stdev=4344.24 00:20:25.562 clat (usec): min=1727, max=315952, avg=127961.86, stdev=66593.57 00:20:25.562 lat (usec): min=1800, max=316017, avg=129709.34, stdev=67532.02 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 14], 5.00th=[ 40], 10.00th=[ 42], 20.00th=[ 73], 00:20:25.562 | 30.00th=[ 88], 40.00th=[ 107], 50.00th=[ 115], 60.00th=[ 134], 00:20:25.562 | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 226], 95.00th=[ 259], 00:20:25.562 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 317], 99.95th=[ 317], 00:20:25.562 | 99.99th=[ 317] 00:20:25.562 bw ( KiB/s): min=59273, max=241664, per=8.04%, avg=126499.80, stdev=52937.37, samples=20 00:20:25.562 iops : min= 231, max= 944, avg=494.05, stdev=206.90, samples=20 00:20:25.562 lat (msec) : 2=0.02%, 4=0.16%, 10=0.54%, 20=0.92%, 50=12.27% 00:20:25.562 lat (msec) : 100=22.29%, 250=57.03%, 500=6.77% 00:20:25.562 cpu : usr=1.52%, sys=1.60%, ctx=1952, majf=0, minf=2 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,5006,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job6: (groupid=0, jobs=1): err= 0: pid=1944458: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=552, BW=138MiB/s (145MB/s)(1392MiB/10071msec); 0 zone resets 00:20:25.562 slat (usec): min=19, max=44182, avg=1406.01, stdev=3533.07 00:20:25.562 clat (usec): min=1223, max=288962, avg=113929.22, stdev=63618.23 00:20:25.562 lat (usec): min=1819, max=289005, avg=115335.23, stdev=64400.13 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 40], 20.00th=[ 74], 00:20:25.562 | 30.00th=[ 80], 40.00th=[ 89], 50.00th=[ 103], 60.00th=[ 115], 00:20:25.562 | 70.00th=[ 129], 80.00th=[ 165], 90.00th=[ 213], 95.00th=[ 241], 00:20:25.562 | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], 00:20:25.562 | 99.99th=[ 288] 00:20:25.562 bw ( KiB/s): min=61828, max=235520, per=8.95%, avg=140863.70, stdev=52493.59, samples=20 00:20:25.562 iops : min= 241, max= 920, avg=550.15, stdev=205.09, samples=20 00:20:25.562 lat (msec) : 2=0.05%, 4=0.65%, 10=3.65%, 20=2.33%, 50=5.64% 00:20:25.562 lat (msec) : 100=36.44%, 250=47.23%, 500=4.01% 00:20:25.562 cpu : usr=1.65%, sys=2.07%, ctx=2533, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,5568,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job7: (groupid=0, jobs=1): err= 0: pid=1944459: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=645, BW=161MiB/s (169MB/s)(1625MiB/10071msec); 0 zone resets 00:20:25.562 slat (usec): min=19, max=46497, avg=1202.78, stdev=2912.19 00:20:25.562 clat (usec): min=1473, max=320367, avg=97948.65, stdev=55564.05 00:20:25.562 lat (usec): min=1497, max=338300, avg=99151.43, stdev=56154.93 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 7], 5.00th=[ 31], 10.00th=[ 41], 20.00th=[ 53], 00:20:25.562 | 30.00th=[ 72], 40.00th=[ 79], 50.00th=[ 82], 60.00th=[ 105], 00:20:25.562 | 70.00th=[ 118], 80.00th=[ 140], 90.00th=[ 163], 95.00th=[ 209], 00:20:25.562 | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 321], 00:20:25.562 | 99.99th=[ 321] 00:20:25.562 bw ( KiB/s): min=61317, max=348672, per=10.46%, avg=164644.40, stdev=68227.88, samples=20 00:20:25.562 iops : min= 239, max= 1362, avg=643.00, stdev=266.47, samples=20 00:20:25.562 lat (msec) : 2=0.06%, 4=0.46%, 10=1.17%, 20=2.15%, 50=15.60% 00:20:25.562 lat (msec) : 100=39.41%, 250=38.09%, 500=3.05% 00:20:25.562 cpu : usr=2.00%, sys=2.47%, ctx=2830, majf=0, minf=1 00:20:25.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:25.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.562 issued rwts: total=0,6498,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.562 job8: (groupid=0, jobs=1): err= 0: pid=1944460: Wed Oct 16 07:18:27 2024 00:20:25.562 write: IOPS=599, BW=150MiB/s (157MB/s)(1522MiB/10149msec); 0 zone resets 00:20:25.562 slat (usec): min=22, max=131202, avg=1147.62, stdev=3356.27 00:20:25.562 clat (msec): min=2, max=356, avg=105.49, stdev=56.67 00:20:25.562 lat (msec): min=4, max=359, avg=106.64, stdev=57.27 00:20:25.562 clat percentiles (msec): 00:20:25.562 | 1.00th=[ 12], 5.00th=[ 29], 10.00th=[ 45], 20.00th=[ 51], 00:20:25.562 | 30.00th=[ 64], 40.00th=[ 82], 50.00th=[ 103], 60.00th=[ 115], 00:20:25.562 | 70.00th=[ 132], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 205], 00:20:25.562 | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 342], 99.95th=[ 347], 00:20:25.562 | 99.99th=[ 359] 00:20:25.562 bw ( KiB/s): min=74240, max=313856, per=9.80%, avg=154184.25, stdev=61947.91, samples=20 00:20:25.562 iops : min= 290, max= 1226, avg=602.20, stdev=241.90, samples=20 00:20:25.562 lat (msec) : 4=0.03%, 10=0.64%, 20=2.04%, 50=14.73%, 100=31.44% 00:20:25.562 lat (msec) : 250=49.95%, 500=1.17% 00:20:25.563 cpu : usr=1.90%, sys=1.95%, ctx=3185, majf=0, minf=1 00:20:25.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:25.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.563 issued rwts: total=0,6088,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.563 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.563 job9: (groupid=0, jobs=1): err= 0: pid=1944461: Wed Oct 16 07:18:27 2024 00:20:25.563 write: IOPS=582, BW=146MiB/s (153MB/s)(1475MiB/10131msec); 0 zone resets 00:20:25.563 slat (usec): min=25, max=110537, avg=1553.13, stdev=3687.42 00:20:25.563 clat (msec): min=5, max=272, avg=108.27, stdev=47.37 00:20:25.563 lat (msec): min=7, max=272, avg=109.83, stdev=48.00 00:20:25.563 clat percentiles (msec): 00:20:25.563 | 1.00th=[ 34], 5.00th=[ 44], 10.00th=[ 45], 20.00th=[ 54], 00:20:25.563 | 30.00th=[ 81], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 120], 00:20:25.563 | 70.00th=[ 126], 80.00th=[ 148], 90.00th=[ 169], 95.00th=[ 199], 00:20:25.563 | 99.00th=[ 224], 99.50th=[ 232], 99.90th=[ 264], 99.95th=[ 264], 00:20:25.563 | 99.99th=[ 271] 00:20:25.563 bw ( KiB/s): min=81756, max=353596, per=9.49%, avg=149304.80, stdev=67258.27, samples=20 00:20:25.563 iops : min= 319, max= 1381, avg=583.10, stdev=262.64, samples=20 00:20:25.563 lat (msec) : 10=0.07%, 20=0.29%, 50=18.97%, 100=21.29%, 250=59.21% 00:20:25.563 lat (msec) : 500=0.17% 00:20:25.563 cpu : usr=1.89%, sys=1.96%, ctx=1740, majf=0, minf=1 00:20:25.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:25.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.563 issued rwts: total=0,5899,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.563 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.563 job10: (groupid=0, jobs=1): err= 0: pid=1944462: Wed Oct 16 07:18:27 2024 00:20:25.563 write: IOPS=551, BW=138MiB/s (144MB/s)(1398MiB/10145msec); 0 zone resets 00:20:25.563 slat (usec): min=20, max=61878, avg=1366.24, stdev=3888.51 00:20:25.563 clat (usec): min=1154, max=332324, avg=114734.04, stdev=77547.38 00:20:25.563 lat (usec): min=1200, max=332371, avg=116100.28, stdev=78557.72 00:20:25.563 clat percentiles (msec): 00:20:25.563 | 1.00th=[ 4], 5.00th=[ 15], 10.00th=[ 34], 20.00th=[ 48], 00:20:25.563 | 30.00th=[ 55], 40.00th=[ 69], 50.00th=[ 93], 60.00th=[ 128], 00:20:25.563 | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 228], 95.00th=[ 257], 00:20:25.563 | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 334], 00:20:25.563 | 99.99th=[ 334] 00:20:25.563 bw ( KiB/s): min=53141, max=332953, per=8.99%, avg=141519.10, stdev=73884.30, samples=20 00:20:25.563 iops : min= 207, max= 1300, avg=552.75, stdev=288.57, samples=20 00:20:25.563 lat (msec) : 2=0.18%, 4=0.86%, 10=2.49%, 20=2.95%, 50=15.01% 00:20:25.563 lat (msec) : 100=31.57%, 250=40.45%, 500=6.49% 00:20:25.563 cpu : usr=1.85%, sys=1.73%, ctx=2677, majf=0, minf=1 00:20:25.563 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:25.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:25.563 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:25.563 issued rwts: total=0,5590,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:25.563 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:25.563 00:20:25.563 Run status group 0 (all jobs): 00:20:25.563 WRITE: bw=1537MiB/s (1612MB/s), 108MiB/s-183MiB/s (113MB/s-192MB/s), io=15.2GiB (16.4GB), run=10071-10150msec 00:20:25.563 00:20:25.563 Disk stats (read/write): 00:20:25.563 nvme0n1: ios=47/10532, merge=0/0, ticks=2511/1211851, in_queue=1214362, util=99.93% 00:20:25.563 nvme10n1: ios=43/8558, merge=0/0, ticks=1798/1213316, in_queue=1215114, util=100.00% 00:20:25.563 nvme1n1: ios=47/11083, merge=0/0, ticks=2229/1207367, in_queue=1209596, util=100.00% 00:20:25.563 nvme2n1: ios=0/14645, merge=0/0, ticks=0/1213497, in_queue=1213497, util=97.79% 00:20:25.563 nvme3n1: ios=0/9626, merge=0/0, ticks=0/1219798, in_queue=1219798, util=97.87% 00:20:25.563 nvme4n1: ios=22/9832, merge=0/0, ticks=100/1209337, in_queue=1209437, util=98.64% 00:20:25.563 nvme5n1: ios=46/10898, merge=0/0, ticks=2446/1209969, in_queue=1212415, util=100.00% 00:20:25.563 nvme6n1: ios=0/12757, merge=0/0, ticks=0/1219265, in_queue=1219265, util=98.43% 00:20:25.563 nvme7n1: ios=0/11989, merge=0/0, ticks=0/1217530, in_queue=1217530, util=98.77% 00:20:25.563 nvme8n1: ios=41/11610, merge=0/0, ticks=1669/1197252, in_queue=1198921, util=100.00% 00:20:25.563 nvme9n1: ios=40/10997, merge=0/0, ticks=1467/1210085, in_queue=1211552, util=100.00% 00:20:25.563 07:18:27 -- target/multiconnection.sh@36 -- # sync 00:20:25.563 07:18:27 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:25.563 07:18:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.563 07:18:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:25.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:25.563 07:18:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:25.563 07:18:27 -- common/autotest_common.sh@1198 -- # local i=0 00:20:25.563 07:18:27 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:25.563 07:18:27 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:20:25.563 07:18:27 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:25.563 07:18:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:20:25.563 07:18:27 -- common/autotest_common.sh@1210 -- # return 0 00:20:25.563 07:18:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:25.563 07:18:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:25.563 07:18:27 -- common/autotest_common.sh@10 -- # set +x 00:20:25.563 07:18:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:25.563 07:18:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.563 07:18:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:25.563 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:25.563 07:18:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:25.563 07:18:28 -- common/autotest_common.sh@1198 -- # local i=0 00:20:25.563 07:18:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:25.563 07:18:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:20:25.563 07:18:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:25.563 07:18:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:20:25.563 07:18:28 -- common/autotest_common.sh@1210 -- # return 0 00:20:25.563 07:18:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:25.563 07:18:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:25.563 07:18:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.563 07:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:25.563 07:18:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.563 07:18:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:25.563 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:25.563 07:18:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:25.563 07:18:28 -- common/autotest_common.sh@1198 -- # local i=0 00:20:25.563 07:18:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:25.563 07:18:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:20:25.563 07:18:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:25.563 07:18:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:20:25.563 07:18:28 -- common/autotest_common.sh@1210 -- # return 0 00:20:25.563 07:18:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:25.563 07:18:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:25.563 07:18:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.563 07:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:25.563 07:18:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.563 07:18:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:25.821 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:25.821 07:18:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:25.821 07:18:28 -- common/autotest_common.sh@1198 -- # local i=0 00:20:25.821 07:18:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:25.821 07:18:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:20:25.821 07:18:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:25.821 07:18:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:20:25.821 07:18:28 -- common/autotest_common.sh@1210 -- # return 0 00:20:25.821 07:18:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:25.821 07:18:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:25.821 07:18:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.821 07:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:25.821 07:18:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.821 07:18:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:25.821 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:25.821 07:18:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:25.821 07:18:28 -- common/autotest_common.sh@1198 -- # local i=0 00:20:25.821 07:18:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:25.821 07:18:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:20:25.821 07:18:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:25.821 07:18:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:20:25.821 07:18:28 -- common/autotest_common.sh@1210 -- # return 0 00:20:25.821 07:18:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:25.821 07:18:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:25.821 07:18:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.821 07:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:25.821 07:18:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:25.821 07:18:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:26.079 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:26.079 07:18:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:26.079 07:18:28 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.079 07:18:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.079 07:18:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:20:26.079 07:18:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.079 07:18:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:20:26.079 07:18:28 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.079 07:18:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:26.079 07:18:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.079 07:18:28 -- common/autotest_common.sh@10 -- # set +x 00:20:26.079 07:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.079 07:18:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.079 07:18:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:26.337 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:26.337 07:18:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:26.337 07:18:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.337 07:18:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.337 07:18:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:20:26.337 07:18:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.337 07:18:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:20:26.337 07:18:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.337 07:18:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:26.337 07:18:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.337 07:18:29 -- common/autotest_common.sh@10 -- # set +x 00:20:26.337 07:18:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.337 07:18:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.337 07:18:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:26.337 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:26.337 07:18:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:26.337 07:18:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.337 07:18:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.337 07:18:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:20:26.337 07:18:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.337 07:18:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:20:26.337 07:18:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.337 07:18:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:26.337 07:18:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.337 07:18:29 -- common/autotest_common.sh@10 -- # set +x 00:20:26.337 07:18:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.337 07:18:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.337 07:18:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:26.595 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:26.595 07:18:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:26.595 07:18:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.595 07:18:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.595 07:18:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:20:26.595 07:18:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:20:26.595 07:18:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.595 07:18:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.595 07:18:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:26.595 07:18:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.595 07:18:29 -- common/autotest_common.sh@10 -- # set +x 00:20:26.595 07:18:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.595 07:18:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.595 07:18:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:26.595 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:26.595 07:18:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:26.595 07:18:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.595 07:18:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.595 07:18:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:20:26.596 07:18:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.596 07:18:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:20:26.596 07:18:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.596 07:18:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:26.596 07:18:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.596 07:18:29 -- common/autotest_common.sh@10 -- # set +x 00:20:26.596 07:18:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.596 07:18:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:26.596 07:18:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:26.596 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:26.596 07:18:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:26.596 07:18:29 -- common/autotest_common.sh@1198 -- # local i=0 00:20:26.596 07:18:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:26.596 07:18:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:20:26.854 07:18:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:26.854 07:18:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:20:26.854 07:18:29 -- common/autotest_common.sh@1210 -- # return 0 00:20:26.854 07:18:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:26.854 07:18:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:26.854 07:18:29 -- common/autotest_common.sh@10 -- # set +x 00:20:26.854 07:18:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:26.854 07:18:29 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:26.854 07:18:29 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:26.854 07:18:29 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:26.854 07:18:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:26.854 07:18:29 -- nvmf/common.sh@116 -- # sync 00:20:26.854 07:18:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:26.854 07:18:29 -- nvmf/common.sh@119 -- # set +e 00:20:26.854 07:18:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:26.854 07:18:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:26.854 rmmod nvme_tcp 00:20:26.854 rmmod nvme_fabrics 00:20:26.854 rmmod nvme_keyring 00:20:26.854 07:18:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:26.854 07:18:29 -- nvmf/common.sh@123 -- # set -e 00:20:26.854 07:18:29 -- nvmf/common.sh@124 -- # return 0 00:20:26.854 07:18:29 -- nvmf/common.sh@477 -- # '[' -n 1938084 ']' 00:20:26.854 07:18:29 -- nvmf/common.sh@478 -- # killprocess 1938084 00:20:26.854 07:18:29 -- common/autotest_common.sh@926 -- # '[' -z 1938084 ']' 00:20:26.854 07:18:29 -- common/autotest_common.sh@930 -- # kill -0 1938084 00:20:26.854 07:18:29 -- common/autotest_common.sh@931 -- # uname 00:20:26.854 07:18:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:26.854 07:18:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1938084 00:20:26.854 07:18:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:26.854 07:18:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:26.854 07:18:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1938084' 00:20:26.854 killing process with pid 1938084 00:20:26.854 07:18:29 -- common/autotest_common.sh@945 -- # kill 1938084 00:20:26.854 07:18:29 -- common/autotest_common.sh@950 -- # wait 1938084 00:20:27.420 07:18:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:27.420 07:18:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:27.420 07:18:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:27.420 07:18:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:27.420 07:18:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:27.420 07:18:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:27.420 07:18:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:27.420 07:18:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:29.467 07:18:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:29.467 00:20:29.467 real 1m0.863s 00:20:29.467 user 3m26.923s 00:20:29.467 sys 0m24.629s 00:20:29.467 07:18:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:29.467 07:18:32 -- common/autotest_common.sh@10 -- # set +x 00:20:29.467 ************************************ 00:20:29.467 END TEST nvmf_multiconnection 00:20:29.467 ************************************ 00:20:29.467 07:18:32 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:29.467 07:18:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:29.467 07:18:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:29.467 07:18:32 -- common/autotest_common.sh@10 -- # set +x 00:20:29.467 ************************************ 00:20:29.467 START TEST nvmf_initiator_timeout 00:20:29.467 ************************************ 00:20:29.467 07:18:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:29.467 * Looking for test storage... 00:20:29.467 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:29.467 07:18:32 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:29.467 07:18:32 -- nvmf/common.sh@7 -- # uname -s 00:20:29.467 07:18:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:29.467 07:18:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:29.467 07:18:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:29.467 07:18:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:29.467 07:18:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:29.467 07:18:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:29.467 07:18:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:29.467 07:18:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:29.467 07:18:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:29.467 07:18:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:29.467 07:18:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:29.467 07:18:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:29.467 07:18:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:29.467 07:18:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:29.467 07:18:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:29.467 07:18:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:29.467 07:18:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:29.467 07:18:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:29.467 07:18:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:29.467 07:18:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.467 07:18:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.467 07:18:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.467 07:18:32 -- paths/export.sh@5 -- # export PATH 00:20:29.467 07:18:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.467 07:18:32 -- nvmf/common.sh@46 -- # : 0 00:20:29.468 07:18:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:29.468 07:18:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:29.468 07:18:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:29.468 07:18:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:29.468 07:18:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:29.468 07:18:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:29.468 07:18:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:29.468 07:18:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:29.468 07:18:32 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:29.468 07:18:32 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:29.468 07:18:32 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:29.468 07:18:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:29.468 07:18:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:29.468 07:18:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:29.468 07:18:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:29.468 07:18:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:29.468 07:18:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:29.468 07:18:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:29.468 07:18:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:29.468 07:18:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:29.468 07:18:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:29.468 07:18:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:29.468 07:18:32 -- common/autotest_common.sh@10 -- # set +x 00:20:31.998 07:18:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:31.998 07:18:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:31.998 07:18:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:31.998 07:18:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:31.998 07:18:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:31.998 07:18:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:31.998 07:18:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:31.998 07:18:34 -- nvmf/common.sh@294 -- # net_devs=() 00:20:31.998 07:18:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:31.998 07:18:34 -- nvmf/common.sh@295 -- # e810=() 00:20:31.998 07:18:34 -- nvmf/common.sh@295 -- # local -ga e810 00:20:31.998 07:18:34 -- nvmf/common.sh@296 -- # x722=() 00:20:31.998 07:18:34 -- nvmf/common.sh@296 -- # local -ga x722 00:20:31.998 07:18:34 -- nvmf/common.sh@297 -- # mlx=() 00:20:31.998 07:18:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:31.998 07:18:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:31.998 07:18:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:31.998 07:18:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:31.998 07:18:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:31.999 07:18:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:31.999 07:18:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:31.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:31.999 07:18:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:31.999 07:18:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:31.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:31.999 07:18:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:31.999 07:18:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:31.999 07:18:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:31.999 07:18:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:31.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:31.999 07:18:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:31.999 07:18:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:31.999 07:18:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:31.999 07:18:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:31.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:31.999 07:18:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:31.999 07:18:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:31.999 07:18:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:31.999 07:18:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:31.999 07:18:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:31.999 07:18:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:31.999 07:18:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:31.999 07:18:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:31.999 07:18:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:31.999 07:18:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:31.999 07:18:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:31.999 07:18:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:31.999 07:18:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:31.999 07:18:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:31.999 07:18:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:31.999 07:18:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:31.999 07:18:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:31.999 07:18:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:31.999 07:18:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:31.999 07:18:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:31.999 07:18:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:31.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:31.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:20:31.999 00:20:31.999 --- 10.0.0.2 ping statistics --- 00:20:31.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:31.999 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:20:31.999 07:18:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:31.999 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:31.999 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.224 ms 00:20:31.999 00:20:31.999 --- 10.0.0.1 ping statistics --- 00:20:31.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:31.999 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:20:31.999 07:18:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:31.999 07:18:34 -- nvmf/common.sh@410 -- # return 0 00:20:31.999 07:18:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:31.999 07:18:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:31.999 07:18:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:31.999 07:18:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:31.999 07:18:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:31.999 07:18:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:31.999 07:18:34 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:31.999 07:18:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:31.999 07:18:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:31.999 07:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:31.999 07:18:34 -- nvmf/common.sh@469 -- # nvmfpid=1947830 00:20:31.999 07:18:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:31.999 07:18:34 -- nvmf/common.sh@470 -- # waitforlisten 1947830 00:20:31.999 07:18:34 -- common/autotest_common.sh@819 -- # '[' -z 1947830 ']' 00:20:31.999 07:18:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:31.999 07:18:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:31.999 07:18:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:31.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:31.999 07:18:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:31.999 07:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:31.999 [2024-10-16 07:18:34.616744] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:31.999 [2024-10-16 07:18:34.616836] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:31.999 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.999 [2024-10-16 07:18:34.686921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:31.999 [2024-10-16 07:18:34.806467] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:31.999 [2024-10-16 07:18:34.806643] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:31.999 [2024-10-16 07:18:34.806671] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:31.999 [2024-10-16 07:18:34.806686] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:31.999 [2024-10-16 07:18:34.806760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:31.999 [2024-10-16 07:18:34.806792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:31.999 [2024-10-16 07:18:34.806845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:31.999 [2024-10-16 07:18:34.806850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:32.933 07:18:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:32.933 07:18:35 -- common/autotest_common.sh@852 -- # return 0 00:20:32.933 07:18:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:32.933 07:18:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:32.933 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.933 07:18:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.933 07:18:35 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 Malloc0 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 Delay0 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 [2024-10-16 07:18:35.634942] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:32.934 07:18:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:32.934 07:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.934 [2024-10-16 07:18:35.663228] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.934 07:18:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:32.934 07:18:35 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:33.500 07:18:36 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:33.500 07:18:36 -- common/autotest_common.sh@1177 -- # local i=0 00:20:33.500 07:18:36 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:20:33.500 07:18:36 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:20:33.500 07:18:36 -- common/autotest_common.sh@1184 -- # sleep 2 00:20:36.027 07:18:38 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:20:36.027 07:18:38 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:20:36.027 07:18:38 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:20:36.027 07:18:38 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:20:36.027 07:18:38 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:20:36.027 07:18:38 -- common/autotest_common.sh@1187 -- # return 0 00:20:36.027 07:18:38 -- target/initiator_timeout.sh@35 -- # fio_pid=1948275 00:20:36.027 07:18:38 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:36.027 07:18:38 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:36.027 [global] 00:20:36.027 thread=1 00:20:36.027 invalidate=1 00:20:36.027 rw=write 00:20:36.027 time_based=1 00:20:36.027 runtime=60 00:20:36.027 ioengine=libaio 00:20:36.027 direct=1 00:20:36.027 bs=4096 00:20:36.027 iodepth=1 00:20:36.027 norandommap=0 00:20:36.027 numjobs=1 00:20:36.027 00:20:36.027 verify_dump=1 00:20:36.027 verify_backlog=512 00:20:36.027 verify_state_save=0 00:20:36.027 do_verify=1 00:20:36.027 verify=crc32c-intel 00:20:36.027 [job0] 00:20:36.027 filename=/dev/nvme0n1 00:20:36.027 Could not set queue depth (nvme0n1) 00:20:36.027 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:36.027 fio-3.35 00:20:36.027 Starting 1 thread 00:20:38.555 07:18:41 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:38.555 07:18:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:38.555 07:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:38.555 true 00:20:38.555 07:18:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:38.555 07:18:41 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:38.555 07:18:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:38.555 07:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:38.555 true 00:20:38.555 07:18:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:38.555 07:18:41 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:38.555 07:18:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:38.555 07:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:38.555 true 00:20:38.555 07:18:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:38.555 07:18:41 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:38.555 07:18:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:38.555 07:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:38.555 true 00:20:38.555 07:18:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:38.555 07:18:41 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:41.834 07:18:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.834 07:18:44 -- common/autotest_common.sh@10 -- # set +x 00:20:41.834 true 00:20:41.834 07:18:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:41.834 07:18:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.834 07:18:44 -- common/autotest_common.sh@10 -- # set +x 00:20:41.834 true 00:20:41.834 07:18:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:41.834 07:18:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.834 07:18:44 -- common/autotest_common.sh@10 -- # set +x 00:20:41.834 true 00:20:41.834 07:18:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:41.834 07:18:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:41.834 07:18:44 -- common/autotest_common.sh@10 -- # set +x 00:20:41.834 true 00:20:41.834 07:18:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:41.834 07:18:44 -- target/initiator_timeout.sh@54 -- # wait 1948275 00:21:38.045 00:21:38.045 job0: (groupid=0, jobs=1): err= 0: pid=1948345: Wed Oct 16 07:19:38 2024 00:21:38.045 read: IOPS=220, BW=882KiB/s (903kB/s)(51.7MiB/60010msec) 00:21:38.045 slat (nsec): min=5537, max=56853, avg=12757.95, stdev=6367.90 00:21:38.045 clat (usec): min=220, max=40914k, avg=4275.72, stdev=355731.02 00:21:38.045 lat (usec): min=228, max=40914k, avg=4288.48, stdev=355731.08 00:21:38.045 clat percentiles (usec): 00:21:38.045 | 1.00th=[ 233], 5.00th=[ 241], 10.00th=[ 245], 20.00th=[ 251], 00:21:38.045 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 277], 60.00th=[ 285], 00:21:38.045 | 70.00th=[ 293], 80.00th=[ 306], 90.00th=[ 347], 95.00th=[ 482], 00:21:38.045 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:21:38.045 | 99.99th=[43254] 00:21:38.045 write: IOPS=221, BW=887KiB/s (909kB/s)(52.0MiB/60010msec); 0 zone resets 00:21:38.045 slat (usec): min=7, max=29786, avg=18.26, stdev=258.13 00:21:38.045 clat (usec): min=172, max=1496, avg=219.32, stdev=29.64 00:21:38.045 lat (usec): min=180, max=30048, avg=237.58, stdev=260.61 00:21:38.045 clat percentiles (usec): 00:21:38.045 | 1.00th=[ 184], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 198], 00:21:38.045 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 219], 60.00th=[ 225], 00:21:38.045 | 70.00th=[ 231], 80.00th=[ 237], 90.00th=[ 245], 95.00th=[ 260], 00:21:38.045 | 99.00th=[ 306], 99.50th=[ 322], 99.90th=[ 388], 99.95th=[ 416], 00:21:38.045 | 99.99th=[ 1434] 00:21:38.045 bw ( KiB/s): min= 4096, max= 8240, per=100.00%, avg=7099.73, stdev=1403.72, samples=15 00:21:38.045 iops : min= 1024, max= 2060, avg=1774.93, stdev=350.93, samples=15 00:21:38.045 lat (usec) : 250=55.34%, 500=42.71%, 750=0.81%, 1000=0.02% 00:21:38.045 lat (msec) : 2=0.03%, 50=1.09%, >=2000=0.01% 00:21:38.045 cpu : usr=0.50%, sys=0.85%, ctx=26547, majf=0, minf=1 00:21:38.045 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:38.045 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.045 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.045 issued rwts: total=13231,13312,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.045 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:38.045 00:21:38.045 Run status group 0 (all jobs): 00:21:38.045 READ: bw=882KiB/s (903kB/s), 882KiB/s-882KiB/s (903kB/s-903kB/s), io=51.7MiB (54.2MB), run=60010-60010msec 00:21:38.045 WRITE: bw=887KiB/s (909kB/s), 887KiB/s-887KiB/s (909kB/s-909kB/s), io=52.0MiB (54.5MB), run=60010-60010msec 00:21:38.045 00:21:38.045 Disk stats (read/write): 00:21:38.045 nvme0n1: ios=13274/13312, merge=0/0, ticks=16651/2806, in_queue=19457, util=99.65% 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:38.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:38.045 07:19:38 -- common/autotest_common.sh@1198 -- # local i=0 00:21:38.045 07:19:38 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:38.045 07:19:38 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:38.045 07:19:38 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:38.045 07:19:38 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:38.045 07:19:38 -- common/autotest_common.sh@1210 -- # return 0 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:38.045 nvmf hotplug test: fio successful as expected 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:38.045 07:19:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:38.045 07:19:38 -- common/autotest_common.sh@10 -- # set +x 00:21:38.045 07:19:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:38.045 07:19:38 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:38.045 07:19:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:38.045 07:19:38 -- nvmf/common.sh@116 -- # sync 00:21:38.045 07:19:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:38.045 07:19:38 -- nvmf/common.sh@119 -- # set +e 00:21:38.045 07:19:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:38.045 07:19:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:38.045 rmmod nvme_tcp 00:21:38.045 rmmod nvme_fabrics 00:21:38.045 rmmod nvme_keyring 00:21:38.045 07:19:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:38.045 07:19:38 -- nvmf/common.sh@123 -- # set -e 00:21:38.045 07:19:38 -- nvmf/common.sh@124 -- # return 0 00:21:38.045 07:19:38 -- nvmf/common.sh@477 -- # '[' -n 1947830 ']' 00:21:38.045 07:19:38 -- nvmf/common.sh@478 -- # killprocess 1947830 00:21:38.045 07:19:38 -- common/autotest_common.sh@926 -- # '[' -z 1947830 ']' 00:21:38.045 07:19:38 -- common/autotest_common.sh@930 -- # kill -0 1947830 00:21:38.045 07:19:38 -- common/autotest_common.sh@931 -- # uname 00:21:38.045 07:19:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:38.045 07:19:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1947830 00:21:38.045 07:19:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:38.045 07:19:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:38.045 07:19:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1947830' 00:21:38.045 killing process with pid 1947830 00:21:38.045 07:19:38 -- common/autotest_common.sh@945 -- # kill 1947830 00:21:38.045 07:19:38 -- common/autotest_common.sh@950 -- # wait 1947830 00:21:38.045 07:19:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:38.045 07:19:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:38.045 07:19:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:38.045 07:19:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:38.045 07:19:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:38.045 07:19:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.045 07:19:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:38.045 07:19:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:38.613 07:19:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:38.613 00:21:38.613 real 1m9.062s 00:21:38.613 user 4m14.008s 00:21:38.613 sys 0m7.305s 00:21:38.613 07:19:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:38.613 07:19:41 -- common/autotest_common.sh@10 -- # set +x 00:21:38.613 ************************************ 00:21:38.613 END TEST nvmf_initiator_timeout 00:21:38.613 ************************************ 00:21:38.613 07:19:41 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:38.613 07:19:41 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:38.613 07:19:41 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:38.613 07:19:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:38.613 07:19:41 -- common/autotest_common.sh@10 -- # set +x 00:21:40.512 07:19:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.512 07:19:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.512 07:19:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.512 07:19:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.512 07:19:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.512 07:19:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.512 07:19:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.512 07:19:43 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.512 07:19:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.512 07:19:43 -- nvmf/common.sh@295 -- # e810=() 00:21:40.512 07:19:43 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.512 07:19:43 -- nvmf/common.sh@296 -- # x722=() 00:21:40.512 07:19:43 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.512 07:19:43 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.512 07:19:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.512 07:19:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.512 07:19:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.512 07:19:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.512 07:19:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.512 07:19:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.512 07:19:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.512 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.512 07:19:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.512 07:19:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.512 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.512 07:19:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.512 07:19:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.512 07:19:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.512 07:19:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.512 07:19:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.512 07:19:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.512 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.512 07:19:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.512 07:19:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.512 07:19:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.512 07:19:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.512 07:19:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.512 07:19:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.512 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.512 07:19:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.512 07:19:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.512 07:19:43 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.512 07:19:43 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:40.512 07:19:43 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:40.512 07:19:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:40.512 07:19:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:40.512 07:19:43 -- common/autotest_common.sh@10 -- # set +x 00:21:40.512 ************************************ 00:21:40.512 START TEST nvmf_perf_adq 00:21:40.512 ************************************ 00:21:40.512 07:19:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:40.512 * Looking for test storage... 00:21:40.512 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:40.512 07:19:43 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:40.512 07:19:43 -- nvmf/common.sh@7 -- # uname -s 00:21:40.512 07:19:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:40.512 07:19:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:40.512 07:19:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:40.512 07:19:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:40.512 07:19:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:40.512 07:19:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:40.512 07:19:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:40.512 07:19:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:40.512 07:19:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:40.512 07:19:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:40.512 07:19:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:40.512 07:19:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:40.512 07:19:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:40.512 07:19:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:40.512 07:19:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:40.512 07:19:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:40.512 07:19:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:40.770 07:19:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:40.770 07:19:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:40.770 07:19:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.771 07:19:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.771 07:19:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.771 07:19:43 -- paths/export.sh@5 -- # export PATH 00:21:40.771 07:19:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.771 07:19:43 -- nvmf/common.sh@46 -- # : 0 00:21:40.771 07:19:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:40.771 07:19:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:40.771 07:19:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:40.771 07:19:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:40.771 07:19:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:40.771 07:19:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:40.771 07:19:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:40.771 07:19:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:40.771 07:19:43 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:40.771 07:19:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:40.771 07:19:43 -- common/autotest_common.sh@10 -- # set +x 00:21:42.675 07:19:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:42.675 07:19:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:42.675 07:19:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:42.675 07:19:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:42.675 07:19:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:42.675 07:19:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:42.675 07:19:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:42.675 07:19:45 -- nvmf/common.sh@294 -- # net_devs=() 00:21:42.675 07:19:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:42.675 07:19:45 -- nvmf/common.sh@295 -- # e810=() 00:21:42.675 07:19:45 -- nvmf/common.sh@295 -- # local -ga e810 00:21:42.675 07:19:45 -- nvmf/common.sh@296 -- # x722=() 00:21:42.675 07:19:45 -- nvmf/common.sh@296 -- # local -ga x722 00:21:42.675 07:19:45 -- nvmf/common.sh@297 -- # mlx=() 00:21:42.675 07:19:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:42.675 07:19:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:42.675 07:19:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:42.675 07:19:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:42.675 07:19:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:42.675 07:19:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:42.675 07:19:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:42.675 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:42.675 07:19:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:42.675 07:19:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:42.675 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:42.675 07:19:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:42.675 07:19:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:42.675 07:19:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:42.675 07:19:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:42.675 07:19:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:42.675 07:19:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:42.675 07:19:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:42.675 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:42.675 07:19:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:42.675 07:19:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:42.675 07:19:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:42.675 07:19:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:42.675 07:19:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:42.675 07:19:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:42.675 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:42.675 07:19:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:42.675 07:19:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:42.675 07:19:45 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:42.675 07:19:45 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:42.675 07:19:45 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:42.675 07:19:45 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:42.676 07:19:45 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:43.610 07:19:46 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:46.139 07:19:48 -- target/perf_adq.sh@54 -- # sleep 5 00:21:51.406 07:19:53 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:51.406 07:19:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:51.407 07:19:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:51.407 07:19:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:51.407 07:19:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:51.407 07:19:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:51.407 07:19:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.407 07:19:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.407 07:19:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:51.407 07:19:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:51.407 07:19:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:51.407 07:19:53 -- common/autotest_common.sh@10 -- # set +x 00:21:51.407 07:19:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:51.407 07:19:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:51.407 07:19:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:51.407 07:19:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:51.407 07:19:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:51.407 07:19:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:51.407 07:19:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:51.407 07:19:53 -- nvmf/common.sh@294 -- # net_devs=() 00:21:51.407 07:19:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:51.407 07:19:53 -- nvmf/common.sh@295 -- # e810=() 00:21:51.407 07:19:53 -- nvmf/common.sh@295 -- # local -ga e810 00:21:51.407 07:19:53 -- nvmf/common.sh@296 -- # x722=() 00:21:51.407 07:19:53 -- nvmf/common.sh@296 -- # local -ga x722 00:21:51.407 07:19:53 -- nvmf/common.sh@297 -- # mlx=() 00:21:51.407 07:19:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:51.407 07:19:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:51.407 07:19:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.407 07:19:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:51.407 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:51.407 07:19:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:51.407 07:19:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:51.407 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:51.407 07:19:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.407 07:19:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.407 07:19:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.407 07:19:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:51.407 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:51.407 07:19:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:51.407 07:19:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:51.407 07:19:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:51.407 07:19:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:51.407 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:51.407 07:19:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:51.407 07:19:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:51.407 07:19:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:51.407 07:19:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:51.407 07:19:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:51.407 07:19:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:51.407 07:19:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:51.407 07:19:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:51.407 07:19:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:51.407 07:19:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:51.407 07:19:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:51.407 07:19:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:51.407 07:19:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:51.407 07:19:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:51.407 07:19:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:51.407 07:19:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:51.407 07:19:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:51.407 07:19:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:51.407 07:19:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:51.407 07:19:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:51.407 07:19:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:51.407 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:51.407 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:21:51.407 00:21:51.407 --- 10.0.0.2 ping statistics --- 00:21:51.407 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:51.407 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:21:51.407 07:19:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:51.407 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:51.407 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:21:51.407 00:21:51.407 --- 10.0.0.1 ping statistics --- 00:21:51.407 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:51.407 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:21:51.407 07:19:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:51.407 07:19:53 -- nvmf/common.sh@410 -- # return 0 00:21:51.407 07:19:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:51.407 07:19:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:51.407 07:19:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:51.407 07:19:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:51.407 07:19:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:51.407 07:19:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:51.407 07:19:53 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:51.407 07:19:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:51.407 07:19:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:51.407 07:19:53 -- common/autotest_common.sh@10 -- # set +x 00:21:51.407 07:19:53 -- nvmf/common.sh@469 -- # nvmfpid=1960285 00:21:51.407 07:19:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:51.407 07:19:53 -- nvmf/common.sh@470 -- # waitforlisten 1960285 00:21:51.407 07:19:53 -- common/autotest_common.sh@819 -- # '[' -z 1960285 ']' 00:21:51.407 07:19:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:51.407 07:19:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:51.407 07:19:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:51.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:51.407 07:19:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:51.407 07:19:53 -- common/autotest_common.sh@10 -- # set +x 00:21:51.407 [2024-10-16 07:19:53.880493] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:21:51.407 [2024-10-16 07:19:53.880584] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:51.407 EAL: No free 2048 kB hugepages reported on node 1 00:21:51.407 [2024-10-16 07:19:53.947921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:51.407 [2024-10-16 07:19:54.066934] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:51.407 [2024-10-16 07:19:54.067107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:51.407 [2024-10-16 07:19:54.067127] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:51.407 [2024-10-16 07:19:54.067141] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:51.407 [2024-10-16 07:19:54.067208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:51.407 [2024-10-16 07:19:54.067264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:51.407 [2024-10-16 07:19:54.067315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:51.407 [2024-10-16 07:19:54.067319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:51.973 07:19:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:51.973 07:19:54 -- common/autotest_common.sh@852 -- # return 0 00:21:51.973 07:19:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:51.973 07:19:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:51.973 07:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:51.973 07:19:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:51.973 07:19:54 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:51.973 07:19:54 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:51.973 07:19:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.973 07:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:51.973 07:19:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.973 07:19:54 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:51.973 07:19:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.973 07:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 07:19:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:54 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:52.232 07:19:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.232 07:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 [2024-10-16 07:19:54.968742] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:52.232 07:19:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:54 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:52.232 07:19:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.232 07:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 Malloc1 00:21:52.232 07:19:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:55 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:52.232 07:19:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.232 07:19:55 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 07:19:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:55 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:52.232 07:19:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.232 07:19:55 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 07:19:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:55 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:52.232 07:19:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.232 07:19:55 -- common/autotest_common.sh@10 -- # set +x 00:21:52.232 [2024-10-16 07:19:55.022203] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:52.232 07:19:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.232 07:19:55 -- target/perf_adq.sh@73 -- # perfpid=1960446 00:21:52.232 07:19:55 -- target/perf_adq.sh@74 -- # sleep 2 00:21:52.232 07:19:55 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:52.232 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.133 07:19:57 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:54.133 07:19:57 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:54.133 07:19:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:54.133 07:19:57 -- target/perf_adq.sh@76 -- # wc -l 00:21:54.133 07:19:57 -- common/autotest_common.sh@10 -- # set +x 00:21:54.133 07:19:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:54.133 07:19:57 -- target/perf_adq.sh@76 -- # count=4 00:21:54.133 07:19:57 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:54.133 07:19:57 -- target/perf_adq.sh@81 -- # wait 1960446 00:22:04.112 Initializing NVMe Controllers 00:22:04.112 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:04.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:04.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:04.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:04.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:04.112 Initialization complete. Launching workers. 00:22:04.112 ======================================================== 00:22:04.112 Latency(us) 00:22:04.112 Device Information : IOPS MiB/s Average min max 00:22:04.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11226.82 43.85 5700.99 1390.18 9181.77 00:22:04.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11359.21 44.37 5634.41 1575.82 9032.43 00:22:04.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10728.74 41.91 5966.01 1989.79 9980.97 00:22:04.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11170.22 43.63 5729.24 1222.60 9836.42 00:22:04.112 ======================================================== 00:22:04.112 Total : 44484.99 173.77 5755.00 1222.60 9980.97 00:22:04.112 00:22:04.112 07:20:05 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:04.112 07:20:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:04.112 07:20:05 -- nvmf/common.sh@116 -- # sync 00:22:04.112 07:20:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:04.112 07:20:05 -- nvmf/common.sh@119 -- # set +e 00:22:04.112 07:20:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:04.112 07:20:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:04.112 rmmod nvme_tcp 00:22:04.112 rmmod nvme_fabrics 00:22:04.112 rmmod nvme_keyring 00:22:04.112 07:20:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:04.112 07:20:05 -- nvmf/common.sh@123 -- # set -e 00:22:04.112 07:20:05 -- nvmf/common.sh@124 -- # return 0 00:22:04.112 07:20:05 -- nvmf/common.sh@477 -- # '[' -n 1960285 ']' 00:22:04.112 07:20:05 -- nvmf/common.sh@478 -- # killprocess 1960285 00:22:04.112 07:20:05 -- common/autotest_common.sh@926 -- # '[' -z 1960285 ']' 00:22:04.112 07:20:05 -- common/autotest_common.sh@930 -- # kill -0 1960285 00:22:04.112 07:20:05 -- common/autotest_common.sh@931 -- # uname 00:22:04.112 07:20:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:04.112 07:20:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1960285 00:22:04.112 07:20:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:04.112 07:20:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:04.112 07:20:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1960285' 00:22:04.112 killing process with pid 1960285 00:22:04.112 07:20:05 -- common/autotest_common.sh@945 -- # kill 1960285 00:22:04.112 07:20:05 -- common/autotest_common.sh@950 -- # wait 1960285 00:22:04.112 07:20:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:04.112 07:20:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:04.112 07:20:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:04.112 07:20:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:04.112 07:20:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:04.112 07:20:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:04.112 07:20:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:04.112 07:20:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.081 07:20:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:05.081 07:20:07 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:05.081 07:20:07 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:05.666 07:20:08 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:08.197 07:20:10 -- target/perf_adq.sh@54 -- # sleep 5 00:22:13.469 07:20:15 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:13.469 07:20:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:13.469 07:20:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:13.469 07:20:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:13.469 07:20:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:13.469 07:20:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:13.469 07:20:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.469 07:20:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.469 07:20:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:13.469 07:20:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:13.469 07:20:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:13.469 07:20:15 -- common/autotest_common.sh@10 -- # set +x 00:22:13.469 07:20:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:13.469 07:20:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:13.469 07:20:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:13.469 07:20:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:13.469 07:20:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:13.469 07:20:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:13.469 07:20:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:13.469 07:20:15 -- nvmf/common.sh@294 -- # net_devs=() 00:22:13.469 07:20:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:13.469 07:20:15 -- nvmf/common.sh@295 -- # e810=() 00:22:13.469 07:20:15 -- nvmf/common.sh@295 -- # local -ga e810 00:22:13.469 07:20:15 -- nvmf/common.sh@296 -- # x722=() 00:22:13.469 07:20:15 -- nvmf/common.sh@296 -- # local -ga x722 00:22:13.469 07:20:15 -- nvmf/common.sh@297 -- # mlx=() 00:22:13.469 07:20:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:13.469 07:20:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:13.469 07:20:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:13.469 07:20:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:13.469 07:20:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:13.469 07:20:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.469 07:20:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:13.469 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:13.469 07:20:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.469 07:20:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:13.469 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:13.469 07:20:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.469 07:20:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:13.470 07:20:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.470 07:20:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.470 07:20:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.470 07:20:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.470 07:20:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:13.470 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:13.470 07:20:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.470 07:20:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.470 07:20:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.470 07:20:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.470 07:20:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.470 07:20:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:13.470 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:13.470 07:20:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.470 07:20:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:13.470 07:20:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:13.470 07:20:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:13.470 07:20:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:13.470 07:20:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:13.470 07:20:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:13.470 07:20:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:13.470 07:20:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:13.470 07:20:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:13.470 07:20:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:13.470 07:20:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:13.470 07:20:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:13.470 07:20:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:13.470 07:20:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:13.470 07:20:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:13.470 07:20:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:13.470 07:20:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:13.470 07:20:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:13.470 07:20:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:13.470 07:20:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:13.470 07:20:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:13.470 07:20:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:13.470 07:20:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:13.470 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:13.470 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.161 ms 00:22:13.470 00:22:13.470 --- 10.0.0.2 ping statistics --- 00:22:13.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.470 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:22:13.470 07:20:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:13.470 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:13.470 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:22:13.470 00:22:13.470 --- 10.0.0.1 ping statistics --- 00:22:13.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.470 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:22:13.470 07:20:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:13.470 07:20:15 -- nvmf/common.sh@410 -- # return 0 00:22:13.470 07:20:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:13.470 07:20:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:13.470 07:20:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:13.470 07:20:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:13.470 07:20:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:13.470 07:20:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:13.470 07:20:15 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:13.470 07:20:15 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:13.470 07:20:15 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:13.470 07:20:15 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:13.470 net.core.busy_poll = 1 00:22:13.470 07:20:15 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:13.470 net.core.busy_read = 1 00:22:13.470 07:20:15 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:13.470 07:20:15 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:13.470 07:20:15 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:13.470 07:20:15 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:13.470 07:20:16 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:13.470 07:20:16 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:13.470 07:20:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:13.470 07:20:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:13.470 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.470 07:20:16 -- nvmf/common.sh@469 -- # nvmfpid=1963264 00:22:13.470 07:20:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:13.470 07:20:16 -- nvmf/common.sh@470 -- # waitforlisten 1963264 00:22:13.470 07:20:16 -- common/autotest_common.sh@819 -- # '[' -z 1963264 ']' 00:22:13.470 07:20:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:13.470 07:20:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:13.470 07:20:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:13.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:13.470 07:20:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:13.470 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.470 [2024-10-16 07:20:16.081496] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:13.470 [2024-10-16 07:20:16.081586] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:13.470 EAL: No free 2048 kB hugepages reported on node 1 00:22:13.470 [2024-10-16 07:20:16.148426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:13.470 [2024-10-16 07:20:16.260253] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:13.470 [2024-10-16 07:20:16.260406] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:13.470 [2024-10-16 07:20:16.260425] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:13.470 [2024-10-16 07:20:16.260437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:13.470 [2024-10-16 07:20:16.260505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:13.470 [2024-10-16 07:20:16.263745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:13.470 [2024-10-16 07:20:16.263828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:13.470 [2024-10-16 07:20:16.263832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:13.470 07:20:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:13.470 07:20:16 -- common/autotest_common.sh@852 -- # return 0 00:22:13.470 07:20:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:13.470 07:20:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:13.470 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.470 07:20:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:13.470 07:20:16 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:13.470 07:20:16 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:13.470 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.470 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.470 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.470 07:20:16 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:13.470 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.470 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:13.728 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.728 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 [2024-10-16 07:20:16.461666] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:13.728 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.728 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 Malloc1 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:13.728 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.728 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:13.728 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.728 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:13.728 07:20:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.728 07:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:13.728 [2024-10-16 07:20:16.515002] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:13.728 07:20:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.728 07:20:16 -- target/perf_adq.sh@94 -- # perfpid=1963297 00:22:13.728 07:20:16 -- target/perf_adq.sh@95 -- # sleep 2 00:22:13.728 07:20:16 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:13.728 EAL: No free 2048 kB hugepages reported on node 1 00:22:15.629 07:20:18 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:15.629 07:20:18 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:15.629 07:20:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:15.629 07:20:18 -- target/perf_adq.sh@97 -- # wc -l 00:22:15.629 07:20:18 -- common/autotest_common.sh@10 -- # set +x 00:22:15.629 07:20:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:15.629 07:20:18 -- target/perf_adq.sh@97 -- # count=2 00:22:15.629 07:20:18 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:15.629 07:20:18 -- target/perf_adq.sh@103 -- # wait 1963297 00:22:23.742 Initializing NVMe Controllers 00:22:23.742 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:23.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:23.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:23.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:23.743 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:23.743 Initialization complete. Launching workers. 00:22:23.743 ======================================================== 00:22:23.743 Latency(us) 00:22:23.743 Device Information : IOPS MiB/s Average min max 00:22:23.743 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 6516.65 25.46 9824.22 1068.48 53828.09 00:22:23.743 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7335.55 28.65 8727.08 1202.08 53904.62 00:22:23.743 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7972.44 31.14 8030.48 964.51 53284.99 00:22:23.743 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7233.05 28.25 8849.58 1231.59 52647.91 00:22:23.743 ======================================================== 00:22:23.743 Total : 29057.70 113.51 8812.50 964.51 53904.62 00:22:23.743 00:22:23.743 07:20:26 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:23.743 07:20:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:23.743 07:20:26 -- nvmf/common.sh@116 -- # sync 00:22:23.743 07:20:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:23.743 07:20:26 -- nvmf/common.sh@119 -- # set +e 00:22:23.743 07:20:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:23.743 07:20:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:23.743 rmmod nvme_tcp 00:22:23.743 rmmod nvme_fabrics 00:22:23.743 rmmod nvme_keyring 00:22:24.001 07:20:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:24.001 07:20:26 -- nvmf/common.sh@123 -- # set -e 00:22:24.001 07:20:26 -- nvmf/common.sh@124 -- # return 0 00:22:24.001 07:20:26 -- nvmf/common.sh@477 -- # '[' -n 1963264 ']' 00:22:24.001 07:20:26 -- nvmf/common.sh@478 -- # killprocess 1963264 00:22:24.001 07:20:26 -- common/autotest_common.sh@926 -- # '[' -z 1963264 ']' 00:22:24.001 07:20:26 -- common/autotest_common.sh@930 -- # kill -0 1963264 00:22:24.001 07:20:26 -- common/autotest_common.sh@931 -- # uname 00:22:24.001 07:20:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:24.001 07:20:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1963264 00:22:24.001 07:20:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:24.001 07:20:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:24.001 07:20:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1963264' 00:22:24.001 killing process with pid 1963264 00:22:24.001 07:20:26 -- common/autotest_common.sh@945 -- # kill 1963264 00:22:24.001 07:20:26 -- common/autotest_common.sh@950 -- # wait 1963264 00:22:24.261 07:20:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:24.261 07:20:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:24.261 07:20:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:24.261 07:20:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:24.261 07:20:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:24.261 07:20:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:24.261 07:20:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:24.261 07:20:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:27.553 07:20:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:27.553 07:20:30 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:27.553 00:22:27.553 real 0m46.674s 00:22:27.553 user 2m41.257s 00:22:27.553 sys 0m9.934s 00:22:27.553 07:20:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:27.553 07:20:30 -- common/autotest_common.sh@10 -- # set +x 00:22:27.553 ************************************ 00:22:27.553 END TEST nvmf_perf_adq 00:22:27.553 ************************************ 00:22:27.553 07:20:30 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:27.553 07:20:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:27.553 07:20:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:27.553 07:20:30 -- common/autotest_common.sh@10 -- # set +x 00:22:27.553 ************************************ 00:22:27.553 START TEST nvmf_shutdown 00:22:27.553 ************************************ 00:22:27.553 07:20:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:27.553 * Looking for test storage... 00:22:27.553 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:27.553 07:20:30 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:27.553 07:20:30 -- nvmf/common.sh@7 -- # uname -s 00:22:27.553 07:20:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:27.553 07:20:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:27.553 07:20:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:27.553 07:20:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:27.553 07:20:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:27.553 07:20:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:27.553 07:20:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:27.553 07:20:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:27.553 07:20:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:27.553 07:20:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:27.553 07:20:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.553 07:20:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:27.553 07:20:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:27.553 07:20:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:27.553 07:20:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:27.553 07:20:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:27.553 07:20:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:27.553 07:20:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:27.553 07:20:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:27.553 07:20:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.553 07:20:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.553 07:20:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.553 07:20:30 -- paths/export.sh@5 -- # export PATH 00:22:27.553 07:20:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:27.553 07:20:30 -- nvmf/common.sh@46 -- # : 0 00:22:27.553 07:20:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:27.553 07:20:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:27.553 07:20:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:27.553 07:20:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:27.553 07:20:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:27.553 07:20:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:27.553 07:20:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:27.553 07:20:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:27.553 07:20:30 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:27.553 07:20:30 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:27.553 07:20:30 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:27.553 07:20:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:27.553 07:20:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:27.553 07:20:30 -- common/autotest_common.sh@10 -- # set +x 00:22:27.553 ************************************ 00:22:27.553 START TEST nvmf_shutdown_tc1 00:22:27.553 ************************************ 00:22:27.553 07:20:30 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:22:27.553 07:20:30 -- target/shutdown.sh@74 -- # starttarget 00:22:27.553 07:20:30 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:27.553 07:20:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:27.554 07:20:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:27.554 07:20:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:27.554 07:20:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:27.554 07:20:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:27.554 07:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.554 07:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.554 07:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:27.554 07:20:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:27.554 07:20:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:27.554 07:20:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:27.554 07:20:30 -- common/autotest_common.sh@10 -- # set +x 00:22:29.455 07:20:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:29.455 07:20:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:29.455 07:20:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:29.455 07:20:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:29.455 07:20:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:29.455 07:20:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:29.455 07:20:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:29.455 07:20:32 -- nvmf/common.sh@294 -- # net_devs=() 00:22:29.455 07:20:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:29.455 07:20:32 -- nvmf/common.sh@295 -- # e810=() 00:22:29.455 07:20:32 -- nvmf/common.sh@295 -- # local -ga e810 00:22:29.455 07:20:32 -- nvmf/common.sh@296 -- # x722=() 00:22:29.455 07:20:32 -- nvmf/common.sh@296 -- # local -ga x722 00:22:29.455 07:20:32 -- nvmf/common.sh@297 -- # mlx=() 00:22:29.455 07:20:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:29.455 07:20:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:29.455 07:20:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.456 07:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:29.456 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:29.456 07:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.456 07:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:29.456 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:29.456 07:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.456 07:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.456 07:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.456 07:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:29.456 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:29.456 07:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.456 07:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.456 07:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.456 07:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:29.456 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:29.456 07:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:29.456 07:20:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:29.456 07:20:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:29.456 07:20:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:29.456 07:20:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:29.456 07:20:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:29.456 07:20:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:29.456 07:20:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:29.456 07:20:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:29.456 07:20:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:29.456 07:20:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:29.456 07:20:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:29.456 07:20:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:29.456 07:20:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:29.456 07:20:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:29.456 07:20:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:29.456 07:20:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:29.456 07:20:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:29.456 07:20:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:29.456 07:20:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:29.456 07:20:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:29.456 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:29.456 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:22:29.456 00:22:29.456 --- 10.0.0.2 ping statistics --- 00:22:29.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.456 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:22:29.456 07:20:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:29.456 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:29.456 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:22:29.456 00:22:29.456 --- 10.0.0.1 ping statistics --- 00:22:29.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.456 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:22:29.456 07:20:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:29.456 07:20:32 -- nvmf/common.sh@410 -- # return 0 00:22:29.456 07:20:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:29.456 07:20:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:29.456 07:20:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:29.456 07:20:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:29.456 07:20:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:29.456 07:20:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:29.456 07:20:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:29.456 07:20:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:29.456 07:20:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:29.456 07:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:29.456 07:20:32 -- nvmf/common.sh@469 -- # nvmfpid=1966636 00:22:29.456 07:20:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:29.456 07:20:32 -- nvmf/common.sh@470 -- # waitforlisten 1966636 00:22:29.456 07:20:32 -- common/autotest_common.sh@819 -- # '[' -z 1966636 ']' 00:22:29.456 07:20:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:29.456 07:20:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:29.456 07:20:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:29.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:29.456 07:20:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:29.456 07:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:29.456 [2024-10-16 07:20:32.351287] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:29.456 [2024-10-16 07:20:32.351370] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:29.456 EAL: No free 2048 kB hugepages reported on node 1 00:22:29.715 [2024-10-16 07:20:32.418246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:29.715 [2024-10-16 07:20:32.533136] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:29.715 [2024-10-16 07:20:32.533306] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:29.715 [2024-10-16 07:20:32.533325] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:29.715 [2024-10-16 07:20:32.533338] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:29.715 [2024-10-16 07:20:32.533455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:29.715 [2024-10-16 07:20:32.533549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:29.715 [2024-10-16 07:20:32.533638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:29.715 [2024-10-16 07:20:32.533656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.652 07:20:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:30.652 07:20:33 -- common/autotest_common.sh@852 -- # return 0 00:22:30.652 07:20:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:30.652 07:20:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:30.652 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.652 07:20:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:30.652 07:20:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:30.652 07:20:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.652 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.652 [2024-10-16 07:20:33.348286] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:30.652 07:20:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:30.652 07:20:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:30.652 07:20:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:30.652 07:20:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:30.652 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.652 07:20:33 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.652 07:20:33 -- target/shutdown.sh@28 -- # cat 00:22:30.652 07:20:33 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:30.652 07:20:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:30.652 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:30.652 Malloc1 00:22:30.652 [2024-10-16 07:20:33.423494] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:30.652 Malloc2 00:22:30.652 Malloc3 00:22:30.652 Malloc4 00:22:30.652 Malloc5 00:22:30.911 Malloc6 00:22:30.911 Malloc7 00:22:30.911 Malloc8 00:22:30.911 Malloc9 00:22:30.911 Malloc10 00:22:31.171 07:20:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:31.171 07:20:33 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:31.171 07:20:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:31.171 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:31.171 07:20:33 -- target/shutdown.sh@78 -- # perfpid=1966825 00:22:31.171 07:20:33 -- target/shutdown.sh@79 -- # waitforlisten 1966825 /var/tmp/bdevperf.sock 00:22:31.171 07:20:33 -- common/autotest_common.sh@819 -- # '[' -z 1966825 ']' 00:22:31.171 07:20:33 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:31.171 07:20:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:31.171 07:20:33 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:31.171 07:20:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:31.171 07:20:33 -- nvmf/common.sh@520 -- # config=() 00:22:31.171 07:20:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:31.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:31.171 07:20:33 -- nvmf/common.sh@520 -- # local subsystem config 00:22:31.171 07:20:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.171 { 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme$subsystem", 00:22:31.171 "trtype": "$TEST_TRANSPORT", 00:22:31.171 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.171 "adrfam": "ipv4", 00:22:31.171 "trsvcid": "$NVMF_PORT", 00:22:31.171 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.171 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.171 "hdgst": ${hdgst:-false}, 00:22:31.171 "ddgst": ${ddgst:-false} 00:22:31.171 }, 00:22:31.171 "method": "bdev_nvme_attach_controller" 00:22:31.171 } 00:22:31.171 EOF 00:22:31.171 )") 00:22:31.171 07:20:33 -- nvmf/common.sh@542 -- # cat 00:22:31.171 07:20:33 -- nvmf/common.sh@544 -- # jq . 00:22:31.171 07:20:33 -- nvmf/common.sh@545 -- # IFS=, 00:22:31.171 07:20:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:31.171 "params": { 00:22:31.171 "name": "Nvme1", 00:22:31.171 "trtype": "tcp", 00:22:31.171 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme2", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme3", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme4", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme5", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme6", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme7", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme8", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme9", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 },{ 00:22:31.172 "params": { 00:22:31.172 "name": "Nvme10", 00:22:31.172 "trtype": "tcp", 00:22:31.172 "traddr": "10.0.0.2", 00:22:31.172 "adrfam": "ipv4", 00:22:31.172 "trsvcid": "4420", 00:22:31.172 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:31.172 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:31.172 "hdgst": false, 00:22:31.172 "ddgst": false 00:22:31.172 }, 00:22:31.172 "method": "bdev_nvme_attach_controller" 00:22:31.172 }' 00:22:31.172 [2024-10-16 07:20:33.922436] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:31.172 [2024-10-16 07:20:33.922509] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:31.172 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.172 [2024-10-16 07:20:33.984543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.172 [2024-10-16 07:20:34.093003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.073 07:20:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:33.073 07:20:35 -- common/autotest_common.sh@852 -- # return 0 00:22:33.073 07:20:35 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:33.073 07:20:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:33.073 07:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:33.073 07:20:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:33.073 07:20:35 -- target/shutdown.sh@83 -- # kill -9 1966825 00:22:33.073 07:20:35 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:33.073 07:20:35 -- target/shutdown.sh@87 -- # sleep 1 00:22:34.009 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1966825 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:34.009 07:20:36 -- target/shutdown.sh@88 -- # kill -0 1966636 00:22:34.009 07:20:36 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:34.009 07:20:36 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:34.009 07:20:36 -- nvmf/common.sh@520 -- # config=() 00:22:34.009 07:20:36 -- nvmf/common.sh@520 -- # local subsystem config 00:22:34.009 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.009 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.009 { 00:22:34.009 "params": { 00:22:34.009 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:34.010 { 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme$subsystem", 00:22:34.010 "trtype": "$TEST_TRANSPORT", 00:22:34.010 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "$NVMF_PORT", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:34.010 "hdgst": ${hdgst:-false}, 00:22:34.010 "ddgst": ${ddgst:-false} 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 } 00:22:34.010 EOF 00:22:34.010 )") 00:22:34.010 07:20:36 -- nvmf/common.sh@542 -- # cat 00:22:34.010 07:20:36 -- nvmf/common.sh@544 -- # jq . 00:22:34.010 07:20:36 -- nvmf/common.sh@545 -- # IFS=, 00:22:34.010 07:20:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme1", 00:22:34.010 "trtype": "tcp", 00:22:34.010 "traddr": "10.0.0.2", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "4420", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:34.010 "hdgst": false, 00:22:34.010 "ddgst": false 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 },{ 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme2", 00:22:34.010 "trtype": "tcp", 00:22:34.010 "traddr": "10.0.0.2", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "4420", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:34.010 "hdgst": false, 00:22:34.010 "ddgst": false 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 },{ 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme3", 00:22:34.010 "trtype": "tcp", 00:22:34.010 "traddr": "10.0.0.2", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "4420", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:34.010 "hdgst": false, 00:22:34.010 "ddgst": false 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 },{ 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme4", 00:22:34.010 "trtype": "tcp", 00:22:34.010 "traddr": "10.0.0.2", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "4420", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:34.010 "hdgst": false, 00:22:34.010 "ddgst": false 00:22:34.010 }, 00:22:34.010 "method": "bdev_nvme_attach_controller" 00:22:34.010 },{ 00:22:34.010 "params": { 00:22:34.010 "name": "Nvme5", 00:22:34.010 "trtype": "tcp", 00:22:34.010 "traddr": "10.0.0.2", 00:22:34.010 "adrfam": "ipv4", 00:22:34.010 "trsvcid": "4420", 00:22:34.010 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:34.010 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:34.010 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 },{ 00:22:34.011 "params": { 00:22:34.011 "name": "Nvme6", 00:22:34.011 "trtype": "tcp", 00:22:34.011 "traddr": "10.0.0.2", 00:22:34.011 "adrfam": "ipv4", 00:22:34.011 "trsvcid": "4420", 00:22:34.011 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:34.011 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:34.011 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 },{ 00:22:34.011 "params": { 00:22:34.011 "name": "Nvme7", 00:22:34.011 "trtype": "tcp", 00:22:34.011 "traddr": "10.0.0.2", 00:22:34.011 "adrfam": "ipv4", 00:22:34.011 "trsvcid": "4420", 00:22:34.011 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:34.011 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:34.011 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 },{ 00:22:34.011 "params": { 00:22:34.011 "name": "Nvme8", 00:22:34.011 "trtype": "tcp", 00:22:34.011 "traddr": "10.0.0.2", 00:22:34.011 "adrfam": "ipv4", 00:22:34.011 "trsvcid": "4420", 00:22:34.011 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:34.011 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:34.011 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 },{ 00:22:34.011 "params": { 00:22:34.011 "name": "Nvme9", 00:22:34.011 "trtype": "tcp", 00:22:34.011 "traddr": "10.0.0.2", 00:22:34.011 "adrfam": "ipv4", 00:22:34.011 "trsvcid": "4420", 00:22:34.011 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:34.011 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:34.011 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 },{ 00:22:34.011 "params": { 00:22:34.011 "name": "Nvme10", 00:22:34.011 "trtype": "tcp", 00:22:34.011 "traddr": "10.0.0.2", 00:22:34.011 "adrfam": "ipv4", 00:22:34.011 "trsvcid": "4420", 00:22:34.011 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:34.011 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:34.011 "hdgst": false, 00:22:34.011 "ddgst": false 00:22:34.011 }, 00:22:34.011 "method": "bdev_nvme_attach_controller" 00:22:34.011 }' 00:22:34.011 [2024-10-16 07:20:36.710241] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:34.011 [2024-10-16 07:20:36.710322] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1967255 ] 00:22:34.011 EAL: No free 2048 kB hugepages reported on node 1 00:22:34.011 [2024-10-16 07:20:36.774857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:34.011 [2024-10-16 07:20:36.883203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:35.918 Running I/O for 1 seconds... 00:22:36.856 00:22:36.856 Latency(us) 00:22:36.856 [2024-10-16T05:20:39.796Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme1n1 : 1.08 369.41 23.09 0.00 0.00 166318.73 66798.17 125052.40 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme2n1 : 1.08 368.33 23.02 0.00 0.00 165461.02 66409.81 121168.78 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme3n1 : 1.11 390.90 24.43 0.00 0.00 158803.72 17185.00 119615.34 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme4n1 : 1.11 389.92 24.37 0.00 0.00 158045.79 17961.72 121945.51 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme5n1 : 1.12 389.04 24.32 0.00 0.00 157506.64 16019.91 121945.51 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme6n1 : 1.12 388.50 24.28 0.00 0.00 156803.30 14854.83 124275.67 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme7n1 : 1.12 386.59 24.16 0.00 0.00 156371.98 16019.91 126605.84 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme8n1 : 1.12 388.95 24.31 0.00 0.00 154325.59 11116.85 130489.46 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme9n1 : 1.10 362.82 22.68 0.00 0.00 162986.92 32428.18 129712.73 00:22:36.856 [2024-10-16T05:20:39.796Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:36.856 Verification LBA range: start 0x0 length 0x400 00:22:36.856 Nvme10n1 : 1.13 386.32 24.15 0.00 0.00 154309.24 6407.96 132042.90 00:22:36.856 [2024-10-16T05:20:39.796Z] =================================================================================================================== 00:22:36.856 [2024-10-16T05:20:39.796Z] Total : 3820.79 238.80 0.00 0.00 158941.26 6407.96 132042.90 00:22:37.115 07:20:39 -- target/shutdown.sh@93 -- # stoptarget 00:22:37.115 07:20:39 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:37.115 07:20:39 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:37.115 07:20:39 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:37.115 07:20:39 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:37.115 07:20:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:37.115 07:20:39 -- nvmf/common.sh@116 -- # sync 00:22:37.115 07:20:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:37.115 07:20:39 -- nvmf/common.sh@119 -- # set +e 00:22:37.115 07:20:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:37.115 07:20:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:37.115 rmmod nvme_tcp 00:22:37.115 rmmod nvme_fabrics 00:22:37.115 rmmod nvme_keyring 00:22:37.115 07:20:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:37.115 07:20:39 -- nvmf/common.sh@123 -- # set -e 00:22:37.115 07:20:39 -- nvmf/common.sh@124 -- # return 0 00:22:37.115 07:20:39 -- nvmf/common.sh@477 -- # '[' -n 1966636 ']' 00:22:37.115 07:20:39 -- nvmf/common.sh@478 -- # killprocess 1966636 00:22:37.115 07:20:39 -- common/autotest_common.sh@926 -- # '[' -z 1966636 ']' 00:22:37.115 07:20:39 -- common/autotest_common.sh@930 -- # kill -0 1966636 00:22:37.115 07:20:39 -- common/autotest_common.sh@931 -- # uname 00:22:37.115 07:20:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:37.115 07:20:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1966636 00:22:37.115 07:20:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:37.115 07:20:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:37.115 07:20:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1966636' 00:22:37.115 killing process with pid 1966636 00:22:37.115 07:20:40 -- common/autotest_common.sh@945 -- # kill 1966636 00:22:37.115 07:20:40 -- common/autotest_common.sh@950 -- # wait 1966636 00:22:37.683 07:20:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:37.683 07:20:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:37.683 07:20:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:37.683 07:20:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:37.683 07:20:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:37.683 07:20:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:37.683 07:20:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:37.683 07:20:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.220 07:20:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:40.221 00:22:40.221 real 0m12.409s 00:22:40.221 user 0m36.899s 00:22:40.221 sys 0m3.167s 00:22:40.221 07:20:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:40.221 07:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:40.221 ************************************ 00:22:40.221 END TEST nvmf_shutdown_tc1 00:22:40.221 ************************************ 00:22:40.221 07:20:42 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:40.221 07:20:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:40.221 07:20:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:40.221 07:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:40.221 ************************************ 00:22:40.221 START TEST nvmf_shutdown_tc2 00:22:40.221 ************************************ 00:22:40.221 07:20:42 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:22:40.221 07:20:42 -- target/shutdown.sh@98 -- # starttarget 00:22:40.221 07:20:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:40.221 07:20:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:40.221 07:20:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:40.221 07:20:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:40.221 07:20:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:40.221 07:20:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:40.221 07:20:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.221 07:20:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.221 07:20:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:40.221 07:20:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:40.221 07:20:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:40.221 07:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:40.221 07:20:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:40.221 07:20:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:40.221 07:20:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:40.221 07:20:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:40.221 07:20:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:40.221 07:20:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:40.221 07:20:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:40.221 07:20:42 -- nvmf/common.sh@294 -- # net_devs=() 00:22:40.221 07:20:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:40.221 07:20:42 -- nvmf/common.sh@295 -- # e810=() 00:22:40.221 07:20:42 -- nvmf/common.sh@295 -- # local -ga e810 00:22:40.221 07:20:42 -- nvmf/common.sh@296 -- # x722=() 00:22:40.221 07:20:42 -- nvmf/common.sh@296 -- # local -ga x722 00:22:40.221 07:20:42 -- nvmf/common.sh@297 -- # mlx=() 00:22:40.221 07:20:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:40.221 07:20:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:40.221 07:20:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:40.221 07:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:40.221 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:40.221 07:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:40.221 07:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:40.221 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:40.221 07:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:40.221 07:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:40.221 07:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:40.221 07:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:40.221 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:40.221 07:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:40.221 07:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:40.221 07:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:40.221 07:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:40.221 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:40.221 07:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:40.221 07:20:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:40.221 07:20:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:40.221 07:20:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:40.221 07:20:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:40.221 07:20:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:40.221 07:20:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:40.221 07:20:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:40.221 07:20:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:40.221 07:20:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:40.221 07:20:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:40.221 07:20:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:40.221 07:20:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:40.221 07:20:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:40.221 07:20:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:40.221 07:20:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:40.221 07:20:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:40.221 07:20:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:40.221 07:20:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:40.221 07:20:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:40.221 07:20:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:40.221 07:20:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:40.221 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:40.221 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:22:40.221 00:22:40.221 --- 10.0.0.2 ping statistics --- 00:22:40.221 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:40.221 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:22:40.221 07:20:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:40.221 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:40.221 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:22:40.221 00:22:40.221 --- 10.0.0.1 ping statistics --- 00:22:40.221 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:40.221 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:22:40.221 07:20:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:40.221 07:20:42 -- nvmf/common.sh@410 -- # return 0 00:22:40.221 07:20:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:40.222 07:20:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:40.222 07:20:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:40.222 07:20:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:40.222 07:20:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:40.222 07:20:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:40.222 07:20:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:40.222 07:20:42 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:40.222 07:20:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:40.222 07:20:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:40.222 07:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:40.222 07:20:42 -- nvmf/common.sh@469 -- # nvmfpid=1968042 00:22:40.222 07:20:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:40.222 07:20:42 -- nvmf/common.sh@470 -- # waitforlisten 1968042 00:22:40.222 07:20:42 -- common/autotest_common.sh@819 -- # '[' -z 1968042 ']' 00:22:40.222 07:20:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:40.222 07:20:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:40.222 07:20:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:40.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:40.222 07:20:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:40.222 07:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:40.222 [2024-10-16 07:20:42.819135] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:40.222 [2024-10-16 07:20:42.819225] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:40.222 EAL: No free 2048 kB hugepages reported on node 1 00:22:40.222 [2024-10-16 07:20:42.884134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:40.222 [2024-10-16 07:20:42.995833] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:40.222 [2024-10-16 07:20:42.995988] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:40.222 [2024-10-16 07:20:42.996006] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:40.222 [2024-10-16 07:20:42.996018] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:40.222 [2024-10-16 07:20:42.996079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:40.222 [2024-10-16 07:20:42.996137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:40.222 [2024-10-16 07:20:42.996215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:40.222 [2024-10-16 07:20:42.996219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:41.157 07:20:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:41.157 07:20:43 -- common/autotest_common.sh@852 -- # return 0 00:22:41.157 07:20:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:41.157 07:20:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:41.157 07:20:43 -- common/autotest_common.sh@10 -- # set +x 00:22:41.157 07:20:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:41.157 07:20:43 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:41.157 07:20:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.157 07:20:43 -- common/autotest_common.sh@10 -- # set +x 00:22:41.157 [2024-10-16 07:20:43.833341] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:41.157 07:20:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.157 07:20:43 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:41.157 07:20:43 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:41.157 07:20:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:41.157 07:20:43 -- common/autotest_common.sh@10 -- # set +x 00:22:41.157 07:20:43 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.157 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.157 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.158 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.158 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.158 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.158 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.158 07:20:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:41.158 07:20:43 -- target/shutdown.sh@28 -- # cat 00:22:41.158 07:20:43 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:41.158 07:20:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.158 07:20:43 -- common/autotest_common.sh@10 -- # set +x 00:22:41.158 Malloc1 00:22:41.158 [2024-10-16 07:20:43.908564] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:41.158 Malloc2 00:22:41.158 Malloc3 00:22:41.158 Malloc4 00:22:41.158 Malloc5 00:22:41.416 Malloc6 00:22:41.416 Malloc7 00:22:41.416 Malloc8 00:22:41.416 Malloc9 00:22:41.416 Malloc10 00:22:41.416 07:20:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.416 07:20:44 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:41.416 07:20:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:41.416 07:20:44 -- common/autotest_common.sh@10 -- # set +x 00:22:41.675 07:20:44 -- target/shutdown.sh@102 -- # perfpid=1968276 00:22:41.675 07:20:44 -- target/shutdown.sh@103 -- # waitforlisten 1968276 /var/tmp/bdevperf.sock 00:22:41.675 07:20:44 -- common/autotest_common.sh@819 -- # '[' -z 1968276 ']' 00:22:41.675 07:20:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:41.675 07:20:44 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:41.675 07:20:44 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:41.675 07:20:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:41.675 07:20:44 -- nvmf/common.sh@520 -- # config=() 00:22:41.675 07:20:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:41.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:41.676 07:20:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:41.676 07:20:44 -- nvmf/common.sh@520 -- # local subsystem config 00:22:41.676 07:20:44 -- common/autotest_common.sh@10 -- # set +x 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:41.676 { 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme$subsystem", 00:22:41.676 "trtype": "$TEST_TRANSPORT", 00:22:41.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "$NVMF_PORT", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:41.676 "hdgst": ${hdgst:-false}, 00:22:41.676 "ddgst": ${ddgst:-false} 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 } 00:22:41.676 EOF 00:22:41.676 )") 00:22:41.676 07:20:44 -- nvmf/common.sh@542 -- # cat 00:22:41.676 07:20:44 -- nvmf/common.sh@544 -- # jq . 00:22:41.676 07:20:44 -- nvmf/common.sh@545 -- # IFS=, 00:22:41.676 07:20:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme1", 00:22:41.676 "trtype": "tcp", 00:22:41.676 "traddr": "10.0.0.2", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "4420", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:41.676 "hdgst": false, 00:22:41.676 "ddgst": false 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 },{ 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme2", 00:22:41.676 "trtype": "tcp", 00:22:41.676 "traddr": "10.0.0.2", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "4420", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:41.676 "hdgst": false, 00:22:41.676 "ddgst": false 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 },{ 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme3", 00:22:41.676 "trtype": "tcp", 00:22:41.676 "traddr": "10.0.0.2", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "4420", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:41.676 "hdgst": false, 00:22:41.676 "ddgst": false 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.676 },{ 00:22:41.676 "params": { 00:22:41.676 "name": "Nvme4", 00:22:41.676 "trtype": "tcp", 00:22:41.676 "traddr": "10.0.0.2", 00:22:41.676 "adrfam": "ipv4", 00:22:41.676 "trsvcid": "4420", 00:22:41.676 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:41.676 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:41.676 "hdgst": false, 00:22:41.676 "ddgst": false 00:22:41.676 }, 00:22:41.676 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme5", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme6", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme7", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme8", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme9", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 },{ 00:22:41.677 "params": { 00:22:41.677 "name": "Nvme10", 00:22:41.677 "trtype": "tcp", 00:22:41.677 "traddr": "10.0.0.2", 00:22:41.677 "adrfam": "ipv4", 00:22:41.677 "trsvcid": "4420", 00:22:41.677 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:41.677 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:41.677 "hdgst": false, 00:22:41.677 "ddgst": false 00:22:41.677 }, 00:22:41.677 "method": "bdev_nvme_attach_controller" 00:22:41.677 }' 00:22:41.677 [2024-10-16 07:20:44.417842] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:41.677 [2024-10-16 07:20:44.417920] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1968276 ] 00:22:41.677 EAL: No free 2048 kB hugepages reported on node 1 00:22:41.677 [2024-10-16 07:20:44.482509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:41.677 [2024-10-16 07:20:44.591694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:43.053 Running I/O for 10 seconds... 00:22:43.312 07:20:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:43.312 07:20:46 -- common/autotest_common.sh@852 -- # return 0 00:22:43.312 07:20:46 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:43.312 07:20:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.312 07:20:46 -- common/autotest_common.sh@10 -- # set +x 00:22:43.312 07:20:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.312 07:20:46 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:43.312 07:20:46 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:43.312 07:20:46 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:43.312 07:20:46 -- target/shutdown.sh@57 -- # local ret=1 00:22:43.312 07:20:46 -- target/shutdown.sh@58 -- # local i 00:22:43.312 07:20:46 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:43.312 07:20:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:43.312 07:20:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:43.312 07:20:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:43.312 07:20:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.312 07:20:46 -- common/autotest_common.sh@10 -- # set +x 00:22:43.571 07:20:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.571 07:20:46 -- target/shutdown.sh@60 -- # read_io_count=87 00:22:43.571 07:20:46 -- target/shutdown.sh@63 -- # '[' 87 -ge 100 ']' 00:22:43.571 07:20:46 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:43.830 07:20:46 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:43.830 07:20:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:43.830 07:20:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:43.830 07:20:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:43.830 07:20:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:43.830 07:20:46 -- common/autotest_common.sh@10 -- # set +x 00:22:43.830 07:20:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:43.830 07:20:46 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:43.830 07:20:46 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:43.830 07:20:46 -- target/shutdown.sh@64 -- # ret=0 00:22:43.830 07:20:46 -- target/shutdown.sh@65 -- # break 00:22:43.830 07:20:46 -- target/shutdown.sh@69 -- # return 0 00:22:43.830 07:20:46 -- target/shutdown.sh@109 -- # killprocess 1968276 00:22:43.830 07:20:46 -- common/autotest_common.sh@926 -- # '[' -z 1968276 ']' 00:22:43.830 07:20:46 -- common/autotest_common.sh@930 -- # kill -0 1968276 00:22:43.830 07:20:46 -- common/autotest_common.sh@931 -- # uname 00:22:43.830 07:20:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:43.830 07:20:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1968276 00:22:43.830 07:20:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:43.830 07:20:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:43.830 07:20:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1968276' 00:22:43.830 killing process with pid 1968276 00:22:43.830 07:20:46 -- common/autotest_common.sh@945 -- # kill 1968276 00:22:43.830 07:20:46 -- common/autotest_common.sh@950 -- # wait 1968276 00:22:43.830 Received shutdown signal, test time was about 0.690439 seconds 00:22:43.830 00:22:43.830 Latency(us) 00:22:43.830 [2024-10-16T05:20:46.770Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme1n1 : 0.67 405.87 25.37 0.00 0.00 152478.64 25631.86 120392.06 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme2n1 : 0.67 403.06 25.19 0.00 0.00 152158.64 23787.14 129712.73 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme3n1 : 0.67 405.01 25.31 0.00 0.00 149253.96 25631.86 116508.44 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme4n1 : 0.67 404.17 25.26 0.00 0.00 147759.76 24855.13 117285.17 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme5n1 : 0.68 402.23 25.14 0.00 0.00 146515.44 27379.48 118061.89 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme6n1 : 0.68 398.72 24.92 0.00 0.00 146057.11 27573.67 117285.17 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme7n1 : 0.68 399.77 24.99 0.00 0.00 143933.98 27185.30 120392.06 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme8n1 : 0.68 397.12 24.82 0.00 0.00 143409.97 27185.30 122722.23 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme9n1 : 0.69 395.78 24.74 0.00 0.00 142517.60 25243.50 121945.51 00:22:43.830 [2024-10-16T05:20:46.770Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:43.830 Verification LBA range: start 0x0 length 0x400 00:22:43.830 Nvme10n1 : 0.69 394.42 24.65 0.00 0.00 141598.27 23592.96 124275.67 00:22:43.830 [2024-10-16T05:20:46.770Z] =================================================================================================================== 00:22:43.830 [2024-10-16T05:20:46.770Z] Total : 4006.17 250.39 0.00 0.00 146568.34 23592.96 129712.73 00:22:44.088 07:20:46 -- target/shutdown.sh@112 -- # sleep 1 00:22:45.024 07:20:47 -- target/shutdown.sh@113 -- # kill -0 1968042 00:22:45.024 07:20:47 -- target/shutdown.sh@115 -- # stoptarget 00:22:45.024 07:20:47 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:45.024 07:20:47 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:45.024 07:20:47 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:45.024 07:20:47 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:45.024 07:20:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:45.024 07:20:47 -- nvmf/common.sh@116 -- # sync 00:22:45.024 07:20:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:45.024 07:20:47 -- nvmf/common.sh@119 -- # set +e 00:22:45.024 07:20:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:45.024 07:20:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:45.283 rmmod nvme_tcp 00:22:45.283 rmmod nvme_fabrics 00:22:45.283 rmmod nvme_keyring 00:22:45.283 07:20:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:45.283 07:20:47 -- nvmf/common.sh@123 -- # set -e 00:22:45.283 07:20:47 -- nvmf/common.sh@124 -- # return 0 00:22:45.283 07:20:47 -- nvmf/common.sh@477 -- # '[' -n 1968042 ']' 00:22:45.283 07:20:47 -- nvmf/common.sh@478 -- # killprocess 1968042 00:22:45.283 07:20:47 -- common/autotest_common.sh@926 -- # '[' -z 1968042 ']' 00:22:45.283 07:20:47 -- common/autotest_common.sh@930 -- # kill -0 1968042 00:22:45.283 07:20:48 -- common/autotest_common.sh@931 -- # uname 00:22:45.283 07:20:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:45.283 07:20:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1968042 00:22:45.283 07:20:48 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:45.283 07:20:48 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:45.283 07:20:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1968042' 00:22:45.283 killing process with pid 1968042 00:22:45.283 07:20:48 -- common/autotest_common.sh@945 -- # kill 1968042 00:22:45.283 07:20:48 -- common/autotest_common.sh@950 -- # wait 1968042 00:22:45.850 07:20:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:45.850 07:20:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:45.850 07:20:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:45.850 07:20:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:45.850 07:20:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:45.850 07:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.850 07:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.850 07:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.758 07:20:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:47.758 00:22:47.758 real 0m8.014s 00:22:47.758 user 0m24.743s 00:22:47.758 sys 0m1.434s 00:22:47.758 07:20:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:47.758 07:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.758 ************************************ 00:22:47.758 END TEST nvmf_shutdown_tc2 00:22:47.758 ************************************ 00:22:47.759 07:20:50 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:47.759 07:20:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:47.759 07:20:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:47.759 07:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.759 ************************************ 00:22:47.759 START TEST nvmf_shutdown_tc3 00:22:47.759 ************************************ 00:22:47.759 07:20:50 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:22:47.759 07:20:50 -- target/shutdown.sh@120 -- # starttarget 00:22:47.759 07:20:50 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:47.759 07:20:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:47.759 07:20:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:47.759 07:20:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:47.759 07:20:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:47.759 07:20:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:47.759 07:20:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:47.759 07:20:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:47.759 07:20:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:47.759 07:20:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:47.759 07:20:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:47.759 07:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:47.759 07:20:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:47.759 07:20:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:47.759 07:20:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:47.759 07:20:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:47.759 07:20:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:47.759 07:20:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:47.759 07:20:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:47.759 07:20:50 -- nvmf/common.sh@294 -- # net_devs=() 00:22:47.759 07:20:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:47.759 07:20:50 -- nvmf/common.sh@295 -- # e810=() 00:22:47.759 07:20:50 -- nvmf/common.sh@295 -- # local -ga e810 00:22:47.759 07:20:50 -- nvmf/common.sh@296 -- # x722=() 00:22:47.759 07:20:50 -- nvmf/common.sh@296 -- # local -ga x722 00:22:47.759 07:20:50 -- nvmf/common.sh@297 -- # mlx=() 00:22:47.759 07:20:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:47.759 07:20:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:47.759 07:20:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:47.759 07:20:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:47.759 07:20:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.759 07:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:47.759 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:47.759 07:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.759 07:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:47.759 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:47.759 07:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.759 07:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.759 07:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.759 07:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:47.759 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:47.759 07:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.759 07:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.759 07:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.759 07:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.759 07:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:47.759 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:47.759 07:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.759 07:20:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:47.759 07:20:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:47.759 07:20:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:47.759 07:20:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:47.759 07:20:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:47.759 07:20:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:47.759 07:20:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:47.759 07:20:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:47.759 07:20:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:47.759 07:20:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:47.759 07:20:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:47.759 07:20:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:47.759 07:20:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:47.759 07:20:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:47.759 07:20:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:47.759 07:20:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:48.019 07:20:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:48.019 07:20:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:48.019 07:20:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:48.019 07:20:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:48.019 07:20:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:48.019 07:20:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:48.019 07:20:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:48.019 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:48.019 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:22:48.019 00:22:48.019 --- 10.0.0.2 ping statistics --- 00:22:48.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.019 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:22:48.019 07:20:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:48.019 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:48.019 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:22:48.019 00:22:48.019 --- 10.0.0.1 ping statistics --- 00:22:48.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.019 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:22:48.019 07:20:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:48.019 07:20:50 -- nvmf/common.sh@410 -- # return 0 00:22:48.019 07:20:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:48.019 07:20:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:48.019 07:20:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:48.019 07:20:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:48.019 07:20:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:48.019 07:20:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:48.019 07:20:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:48.019 07:20:50 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:48.019 07:20:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:48.019 07:20:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:48.019 07:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:48.019 07:20:50 -- nvmf/common.sh@469 -- # nvmfpid=1969168 00:22:48.019 07:20:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:48.019 07:20:50 -- nvmf/common.sh@470 -- # waitforlisten 1969168 00:22:48.019 07:20:50 -- common/autotest_common.sh@819 -- # '[' -z 1969168 ']' 00:22:48.019 07:20:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.019 07:20:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:48.019 07:20:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.019 07:20:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:48.019 07:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:48.019 [2024-10-16 07:20:50.886486] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:48.019 [2024-10-16 07:20:50.886568] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:48.019 EAL: No free 2048 kB hugepages reported on node 1 00:22:48.019 [2024-10-16 07:20:50.957282] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:48.280 [2024-10-16 07:20:51.072867] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:48.280 [2024-10-16 07:20:51.073031] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:48.280 [2024-10-16 07:20:51.073051] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:48.280 [2024-10-16 07:20:51.073065] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:48.280 [2024-10-16 07:20:51.073175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:48.280 [2024-10-16 07:20:51.073270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:48.280 [2024-10-16 07:20:51.073316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:48.280 [2024-10-16 07:20:51.073320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.937 07:20:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:48.937 07:20:51 -- common/autotest_common.sh@852 -- # return 0 00:22:48.937 07:20:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:48.937 07:20:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:48.937 07:20:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.937 07:20:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:48.937 07:20:51 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.937 07:20:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:48.937 07:20:51 -- common/autotest_common.sh@10 -- # set +x 00:22:48.937 [2024-10-16 07:20:51.874233] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:49.195 07:20:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:49.195 07:20:51 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:49.195 07:20:51 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:49.195 07:20:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:49.195 07:20:51 -- common/autotest_common.sh@10 -- # set +x 00:22:49.195 07:20:51 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:49.195 07:20:51 -- target/shutdown.sh@28 -- # cat 00:22:49.195 07:20:51 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:49.195 07:20:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:49.195 07:20:51 -- common/autotest_common.sh@10 -- # set +x 00:22:49.195 Malloc1 00:22:49.195 [2024-10-16 07:20:51.949395] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:49.195 Malloc2 00:22:49.195 Malloc3 00:22:49.195 Malloc4 00:22:49.195 Malloc5 00:22:49.454 Malloc6 00:22:49.454 Malloc7 00:22:49.454 Malloc8 00:22:49.454 Malloc9 00:22:49.454 Malloc10 00:22:49.454 07:20:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:49.454 07:20:52 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:49.454 07:20:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:49.454 07:20:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.712 07:20:52 -- target/shutdown.sh@124 -- # perfpid=1969482 00:22:49.712 07:20:52 -- target/shutdown.sh@125 -- # waitforlisten 1969482 /var/tmp/bdevperf.sock 00:22:49.712 07:20:52 -- common/autotest_common.sh@819 -- # '[' -z 1969482 ']' 00:22:49.712 07:20:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:49.712 07:20:52 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:49.712 07:20:52 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:49.713 07:20:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:49.713 07:20:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:49.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:49.713 07:20:52 -- nvmf/common.sh@520 -- # config=() 00:22:49.713 07:20:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:49.713 07:20:52 -- nvmf/common.sh@520 -- # local subsystem config 00:22:49.713 07:20:52 -- common/autotest_common.sh@10 -- # set +x 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.713 "adrfam": "ipv4", 00:22:49.713 "trsvcid": "$NVMF_PORT", 00:22:49.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.713 "hdgst": ${hdgst:-false}, 00:22:49.713 "ddgst": ${ddgst:-false} 00:22:49.713 }, 00:22:49.713 "method": "bdev_nvme_attach_controller" 00:22:49.713 } 00:22:49.713 EOF 00:22:49.713 )") 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.713 07:20:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:49.713 07:20:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:49.713 { 00:22:49.713 "params": { 00:22:49.713 "name": "Nvme$subsystem", 00:22:49.713 "trtype": "$TEST_TRANSPORT", 00:22:49.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "$NVMF_PORT", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:49.714 "hdgst": ${hdgst:-false}, 00:22:49.714 "ddgst": ${ddgst:-false} 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 } 00:22:49.714 EOF 00:22:49.714 )") 00:22:49.714 07:20:52 -- nvmf/common.sh@542 -- # cat 00:22:49.714 07:20:52 -- nvmf/common.sh@544 -- # jq . 00:22:49.714 07:20:52 -- nvmf/common.sh@545 -- # IFS=, 00:22:49.714 07:20:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme1", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme2", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme3", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme4", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme5", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme6", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme7", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme8", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme9", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 },{ 00:22:49.714 "params": { 00:22:49.714 "name": "Nvme10", 00:22:49.714 "trtype": "tcp", 00:22:49.714 "traddr": "10.0.0.2", 00:22:49.714 "adrfam": "ipv4", 00:22:49.714 "trsvcid": "4420", 00:22:49.714 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:49.714 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:49.714 "hdgst": false, 00:22:49.714 "ddgst": false 00:22:49.714 }, 00:22:49.714 "method": "bdev_nvme_attach_controller" 00:22:49.714 }' 00:22:49.714 [2024-10-16 07:20:52.441894] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:49.714 [2024-10-16 07:20:52.441972] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1969482 ] 00:22:49.714 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.714 [2024-10-16 07:20:52.503506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:49.714 [2024-10-16 07:20:52.612069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:51.614 Running I/O for 10 seconds... 00:22:51.614 07:20:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:51.614 07:20:54 -- common/autotest_common.sh@852 -- # return 0 00:22:51.614 07:20:54 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:51.614 07:20:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.614 07:20:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.614 07:20:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.614 07:20:54 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:51.614 07:20:54 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:51.614 07:20:54 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:51.614 07:20:54 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:51.614 07:20:54 -- target/shutdown.sh@57 -- # local ret=1 00:22:51.614 07:20:54 -- target/shutdown.sh@58 -- # local i 00:22:51.614 07:20:54 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:51.614 07:20:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:51.614 07:20:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:51.614 07:20:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:51.614 07:20:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.614 07:20:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.614 07:20:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.614 07:20:54 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:51.614 07:20:54 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:51.614 07:20:54 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:51.891 07:20:54 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:51.891 07:20:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:51.891 07:20:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:51.891 07:20:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:51.891 07:20:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.891 07:20:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.891 07:20:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.891 07:20:54 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:51.891 07:20:54 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:51.891 07:20:54 -- target/shutdown.sh@64 -- # ret=0 00:22:51.891 07:20:54 -- target/shutdown.sh@65 -- # break 00:22:51.891 07:20:54 -- target/shutdown.sh@69 -- # return 0 00:22:51.891 07:20:54 -- target/shutdown.sh@134 -- # killprocess 1969168 00:22:51.891 07:20:54 -- common/autotest_common.sh@926 -- # '[' -z 1969168 ']' 00:22:51.891 07:20:54 -- common/autotest_common.sh@930 -- # kill -0 1969168 00:22:51.891 07:20:54 -- common/autotest_common.sh@931 -- # uname 00:22:51.891 07:20:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:51.891 07:20:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1969168 00:22:51.891 07:20:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:51.891 07:20:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:51.891 07:20:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1969168' 00:22:51.891 killing process with pid 1969168 00:22:51.891 07:20:54 -- common/autotest_common.sh@945 -- # kill 1969168 00:22:51.891 07:20:54 -- common/autotest_common.sh@950 -- # wait 1969168 00:22:51.891 [2024-10-16 07:20:54.648376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648589] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648641] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648653] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648702] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.891 [2024-10-16 07:20:54.648736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648864] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648877] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648915] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.648988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649094] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649144] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649206] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.649317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e2e0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650690] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650767] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650792] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650830] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650844] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650856] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650868] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650880] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650892] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.650991] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651040] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651080] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651117] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651153] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651256] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.892 [2024-10-16 07:20:54.651268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651379] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651416] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.651518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10cb0 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.652939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.652964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.652988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653101] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653150] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653225] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653353] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653415] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653515] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653589] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653617] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653643] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653656] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653717] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653750] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0e790 is same with the state(5) to be set 00:22:51.893 [2024-10-16 07:20:54.653935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.893 [2024-10-16 07:20:54.653978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.893 [2024-10-16 07:20:54.654004] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.893 [2024-10-16 07:20:54.654018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.893 [2024-10-16 07:20:54.654032] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a3590 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.654154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654193] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654237] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.894 [2024-10-16 07:20:54.654283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.894 [2024-10-16 07:20:54.654296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224af70 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660485] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660525] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660612] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660625] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660662] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660674] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660810] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660874] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660886] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660911] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.660997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661059] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661176] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661189] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.661251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ec40 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662596] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662621] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662634] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662683] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.894 [2024-10-16 07:20:54.662696] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662708] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662721] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662747] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662910] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662922] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.662998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663023] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663048] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663060] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663109] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663176] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663225] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663273] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663392] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.663430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f0d0 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.664181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2411600 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.664368] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664456] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2276690 is same with the state(5) to be set 00:22:51.895 [2024-10-16 07:20:54.664525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a3590 (9): Bad file descriptor 00:22:51.895 [2024-10-16 07:20:54.664582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.895 [2024-10-16 07:20:54.664629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.895 [2024-10-16 07:20:54.664642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.664656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.896 [2024-10-16 07:20:54.664668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.664681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.896 [2024-10-16 07:20:54.664693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.664705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x226d1b0 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.664741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224af70 (9): Bad file descriptor 00:22:51.896 [2024-10-16 07:20:54.665518] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.896 [2024-10-16 07:20:54.665596] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.896 [2024-10-16 07:20:54.665671] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.896 [2024-10-16 07:20:54.666722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666836] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.896 [2024-10-16 07:20:54.666855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666887] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.666997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667019] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667104] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667221] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667291] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.896 [2024-10-16 07:20:54.667308] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667374] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667426] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667451] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667488] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667711] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667724] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.667909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0f580 is same with the state(5) to be set 00:22:51.896 [2024-10-16 07:20:54.671318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.896 [2024-10-16 07:20:54.671562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.896 [2024-10-16 07:20:54.671575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.671983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.671997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.672116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.897 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28672 len:12[2024-10-16 07:20:54.672195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.672277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28800 len:12the state(5) to be set 00:22:51.897 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672323] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672336] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:12[2024-10-16 07:20:54.672348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672362] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.672362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.897 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672388] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672542] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.897 [2024-10-16 07:20:54.672561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.897 [2024-10-16 07:20:54.672577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.897 [2024-10-16 07:20:54.672588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672615] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.672628] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.672675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:12the state(5) to be set 00:22:51.898 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.672764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:31872 len:1the state(5) to be set 00:22:51.898 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672863] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672876] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.672980] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.672986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.672999] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.673038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:1the state(5) to be set 00:22:51.898 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with [2024-10-16 07:20:54.673055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.898 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673124] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673161] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673235] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673248] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33408 len:1[2024-10-16 07:20:54.673274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fa30 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 the state(5) to be set 00:22:51.898 [2024-10-16 07:20:54.673290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.898 [2024-10-16 07:20:54.673563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.898 [2024-10-16 07:20:54.673579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.899 [2024-10-16 07:20:54.673592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.673607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.899 [2024-10-16 07:20:54.673622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.673636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249a950 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.673737] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x249a950 was disconnected and freed. reset controller. 00:22:51.899 [2024-10-16 07:20:54.674324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674462] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2401150 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.674514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2411600 (9): Bad file descriptor 00:22:51.899 [2024-10-16 07:20:54.674555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2276690 (9): Bad file descriptor 00:22:51.899 [2024-10-16 07:20:54.674617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.899 [2024-10-16 07:20:54.674717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.899 [2024-10-16 07:20:54.674738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ec0a0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.674775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x226d1b0 (9): Bad file descriptor 00:22:51.899 [2024-10-16 07:20:54.675135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675165] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675206] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675286] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675323] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675434] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675446] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675461] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675474] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675523] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675598] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675639] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675651] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675700] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675725] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675747] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675886] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675910] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675922] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.899 [2024-10-16 07:20:54.675946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.675958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0fee0 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.676464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:51.900 [2024-10-16 07:20:54.676512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2401150 (9): Bad file descriptor 00:22:51.900 [2024-10-16 07:20:54.676570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.676964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.676980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:12[2024-10-16 07:20:54.677203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677217] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:12the state(5) to be set 00:22:51.900 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.900 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:12[2024-10-16 07:20:54.677330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.900 [2024-10-16 07:20:54.677373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.900 [2024-10-16 07:20:54.677386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.900 [2024-10-16 07:20:54.677396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677426] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:12the state(5) to be set 00:22:51.901 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677446] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:12[2024-10-16 07:20:54.677461] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.901 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677531] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30592 len:1[2024-10-16 07:20:54.677557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677641] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677655] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677709] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31616 len:12[2024-10-16 07:20:54.677832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.901 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677875] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31744 len:12the state(5) to be set 00:22:51.901 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with [2024-10-16 07:20:54.677891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:51.901 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677904] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.677943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.677956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32128 len:12[2024-10-16 07:20:54.677970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.677984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-16 07:20:54.677985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.678000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.678002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.678013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10370 is same with the state(5) to be set 00:22:51.901 [2024-10-16 07:20:54.678016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.678032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.901 [2024-10-16 07:20:54.678049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.901 [2024-10-16 07:20:54.678066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.902 [2024-10-16 07:20:54.678563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.902 [2024-10-16 07:20:54.678577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x248f260 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678844] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678856] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678874] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678886] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678910] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678954] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.678990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679063] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679099] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679185] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679234] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679246] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679287] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679299] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679336] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.902 [2024-10-16 07:20:54.679397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679421] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679482] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679494] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.679543] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c10800 is same with the state(5) to be set 00:22:51.903 [2024-10-16 07:20:54.680140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.680980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.680994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.903 [2024-10-16 07:20:54.681169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.903 [2024-10-16 07:20:54.681184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.681976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.681991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.904 [2024-10-16 07:20:54.682004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.682018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24a15b0 is same with the state(5) to be set 00:22:51.904 [2024-10-16 07:20:54.683699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:51.904 [2024-10-16 07:20:54.683742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:51.904 [2024-10-16 07:20:54.684598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.684705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.684738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2401150 with addr=10.0.0.2, port=4420 00:22:51.904 [2024-10-16 07:20:54.684757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2401150 is same with the state(5) to be set 00:22:51.904 [2024-10-16 07:20:54.684849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.684951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.684976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x224af70 with addr=10.0.0.2, port=4420 00:22:51.904 [2024-10-16 07:20:54.684991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224af70 is same with the state(5) to be set 00:22:51.904 [2024-10-16 07:20:54.685088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.685175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.904 [2024-10-16 07:20:54.685198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22a3590 with addr=10.0.0.2, port=4420 00:22:51.904 [2024-10-16 07:20:54.685213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a3590 is same with the state(5) to be set 00:22:51.904 [2024-10-16 07:20:54.685256] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.904 [2024-10-16 07:20:54.685276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.685292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.904 [2024-10-16 07:20:54.685305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.904 [2024-10-16 07:20:54.685318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2400c70 is same with the state(5) to be set 00:22:51.905 [2024-10-16 07:20:54.685415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ec0a0 (9): Bad file descriptor 00:22:51.905 [2024-10-16 07:20:54.685476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fba60 is same with the state(5) to be set 00:22:51.905 [2024-10-16 07:20:54.685640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685675] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685700] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685739] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:51.905 [2024-10-16 07:20:54.685755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.685768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2298490 is same with the state(5) to be set 00:22:51.905 [2024-10-16 07:20:54.686163] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.905 [2024-10-16 07:20:54.686705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2401150 (9): Bad file descriptor 00:22:51.905 [2024-10-16 07:20:54.686749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224af70 (9): Bad file descriptor 00:22:51.905 [2024-10-16 07:20:54.686786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a3590 (9): Bad file descriptor 00:22:51.905 [2024-10-16 07:20:54.686854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.686876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.686899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.686915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.686932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.686945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.686961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.686973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.686989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.905 [2024-10-16 07:20:54.687662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.905 [2024-10-16 07:20:54.687677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.687984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.687997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.688740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.688757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x223b550 is same with the state(5) to be set 00:22:51.906 [2024-10-16 07:20:54.690041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.690085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.690118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.690153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.690183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.906 [2024-10-16 07:20:54.690212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.906 [2024-10-16 07:20:54.690226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.690981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.690996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.907 [2024-10-16 07:20:54.691456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.907 [2024-10-16 07:20:54.691469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.691982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.691996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23d71a0 is same with the state(5) to be set 00:22:51.908 [2024-10-16 07:20:54.693225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.908 [2024-10-16 07:20:54.693818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.908 [2024-10-16 07:20:54.693832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.693861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.693895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.693925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.693954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.693982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.693998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.694618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.694633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.700945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.909 [2024-10-16 07:20:54.701391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.909 [2024-10-16 07:20:54.701404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.701420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.701433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.701448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.701465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.701480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23d86f0 is same with the state(5) to be set 00:22:51.910 [2024-10-16 07:20:54.703189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:51.910 [2024-10-16 07:20:54.703233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:51.910 [2024-10-16 07:20:54.703254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:51.910 [2024-10-16 07:20:54.703317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:51.910 [2024-10-16 07:20:54.703335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:51.910 [2024-10-16 07:20:54.703353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:51.910 [2024-10-16 07:20:54.703381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:51.910 [2024-10-16 07:20:54.703395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:51.910 [2024-10-16 07:20:54.703408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:51.910 [2024-10-16 07:20:54.703426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:51.910 [2024-10-16 07:20:54.703439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:51.910 [2024-10-16 07:20:54.703451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:51.910 [2024-10-16 07:20:54.703510] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.910 [2024-10-16 07:20:54.703535] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.910 [2024-10-16 07:20:54.703554] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.910 [2024-10-16 07:20:54.703580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2400c70 (9): Bad file descriptor 00:22:51.910 [2024-10-16 07:20:54.703625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23fba60 (9): Bad file descriptor 00:22:51.910 [2024-10-16 07:20:54.703659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2298490 (9): Bad file descriptor 00:22:51.910 [2024-10-16 07:20:54.703813] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.910 [2024-10-16 07:20:54.703901] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.910 [2024-10-16 07:20:54.704018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.910 [2024-10-16 07:20:54.704042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.910 [2024-10-16 07:20:54.704054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.910 [2024-10-16 07:20:54.704185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2411600 with addr=10.0.0.2, port=4420 00:22:51.910 [2024-10-16 07:20:54.704330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2411600 is same with the state(5) to be set 00:22:51.910 [2024-10-16 07:20:54.704426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x226d1b0 with addr=10.0.0.2, port=4420 00:22:51.910 [2024-10-16 07:20:54.704559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x226d1b0 is same with the state(5) to be set 00:22:51.910 [2024-10-16 07:20:54.704650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.910 [2024-10-16 07:20:54.704775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2276690 with addr=10.0.0.2, port=4420 00:22:51.910 [2024-10-16 07:20:54.704790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2276690 is same with the state(5) to be set 00:22:51.910 [2024-10-16 07:20:54.705657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.705978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.705992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.910 [2024-10-16 07:20:54.706377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.910 [2024-10-16 07:20:54.706390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.706972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.706988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.911 [2024-10-16 07:20:54.707521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.911 [2024-10-16 07:20:54.707535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249be00 is same with the state(5) to be set 00:22:51.911 [2024-10-16 07:20:54.708860] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:51.911 [2024-10-16 07:20:54.708903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:51.911 [2024-10-16 07:20:54.708949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2411600 (9): Bad file descriptor 00:22:51.911 [2024-10-16 07:20:54.708972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x226d1b0 (9): Bad file descriptor 00:22:51.911 [2024-10-16 07:20:54.708990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2276690 (9): Bad file descriptor 00:22:51.912 [2024-10-16 07:20:54.709210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.912 [2024-10-16 07:20:54.709302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.912 [2024-10-16 07:20:54.709326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ec0a0 with addr=10.0.0.2, port=4420 00:22:51.912 [2024-10-16 07:20:54.709342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ec0a0 is same with the state(5) to be set 00:22:51.912 [2024-10-16 07:20:54.709358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:51.912 [2024-10-16 07:20:54.709371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:51.912 [2024-10-16 07:20:54.709386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:51.912 [2024-10-16 07:20:54.709407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:51.912 [2024-10-16 07:20:54.709421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:51.912 [2024-10-16 07:20:54.709434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:51.912 [2024-10-16 07:20:54.709450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:51.912 [2024-10-16 07:20:54.709464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:51.912 [2024-10-16 07:20:54.709476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:51.912 [2024-10-16 07:20:54.709818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.912 [2024-10-16 07:20:54.709841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.912 [2024-10-16 07:20:54.709859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.912 [2024-10-16 07:20:54.709876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ec0a0 (9): Bad file descriptor 00:22:51.912 [2024-10-16 07:20:54.709926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:51.912 [2024-10-16 07:20:54.709944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:51.912 [2024-10-16 07:20:54.709957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:51.912 [2024-10-16 07:20:54.710007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.912 [2024-10-16 07:20:54.713344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.713973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.713988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.912 [2024-10-16 07:20:54.714185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.912 [2024-10-16 07:20:54.714199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.714975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.714991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.715272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.715286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249d3e0 is same with the state(5) to be set 00:22:51.913 [2024-10-16 07:20:54.716549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.716572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.716592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.716608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.716623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.716637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.716652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.716666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.716681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.913 [2024-10-16 07:20:54.716694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.913 [2024-10-16 07:20:54.716709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.716981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.716995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.914 [2024-10-16 07:20:54.717922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.914 [2024-10-16 07:20:54.717937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.717950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.717965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.717978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.717993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.718403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.718417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249e9c0 is same with the state(5) to be set 00:22:51.915 [2024-10-16 07:20:54.719625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.719982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.719998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.915 [2024-10-16 07:20:54.720344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.915 [2024-10-16 07:20:54.720358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.720975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.720988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:51.916 [2024-10-16 07:20:54.721466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:51.916 [2024-10-16 07:20:54.721479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x249ffa0 is same with the state(5) to be set 00:22:51.916 [2024-10-16 07:20:54.723147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:51.916 [2024-10-16 07:20:54.723184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:51.916 [2024-10-16 07:20:54.723202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:51.916 [2024-10-16 07:20:54.723220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:51.916 [2024-10-16 07:20:54.723237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:51.917 task offset: 29184 on job bdev=Nvme5n1 fails 00:22:51.917 00:22:51.917 Latency(us) 00:22:51.917 [2024-10-16T05:20:54.857Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme1n1 ended in about 0.64 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme1n1 : 0.64 325.72 20.36 100.22 0.00 149068.70 85827.89 120392.06 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme2n1 ended in about 0.65 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme2n1 : 0.65 320.62 20.04 98.65 0.00 149726.92 74565.40 124275.67 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme3n1 ended in about 0.65 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme3n1 : 0.65 319.05 19.94 98.17 0.00 148671.77 81167.55 130489.46 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme4n1 ended in about 0.66 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme4n1 : 0.66 314.46 19.65 96.76 0.00 149163.65 91653.31 118061.89 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme5n1 ended in about 0.63 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme5n1 : 0.63 327.62 20.48 100.81 0.00 141132.28 52817.16 118838.61 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme6n1 ended in about 0.67 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme6n1 : 0.67 311.63 19.48 95.89 0.00 147064.78 74953.77 119615.34 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme7n1 ended in about 0.68 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme7n1 : 0.68 308.06 19.25 94.79 0.00 147126.18 73400.32 121945.51 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme8n1 ended in about 0.68 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme8n1 : 0.68 306.65 19.17 94.35 0.00 146108.87 64856.37 125052.40 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme9n1 ended in about 0.68 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme9n1 : 0.68 305.27 19.08 93.93 0.00 145105.84 58254.22 124275.67 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:51.917 [2024-10-16T05:20:54.857Z] Job: Nvme10n1 ended in about 0.64 seconds with error 00:22:51.917 Verification LBA range: start 0x0 length 0x400 00:22:51.917 Nvme10n1 : 0.64 255.46 15.97 99.69 0.00 160107.13 100973.99 125829.12 00:22:51.917 [2024-10-16T05:20:54.857Z] =================================================================================================================== 00:22:51.917 [2024-10-16T05:20:54.857Z] Total : 3094.53 193.41 973.25 0.00 148133.93 52817.16 130489.46 00:22:51.917 [2024-10-16 07:20:54.749844] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:51.917 [2024-10-16 07:20:54.750199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:51.917 [2024-10-16 07:20:54.750550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.750666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.750694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22a3590 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.750716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a3590 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.750851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.750950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.750976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x224af70 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.750993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224af70 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.751087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2401150 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.751239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2401150 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.751318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23fba60 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.751480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23fba60 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.751559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.751678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2400c70 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.751693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2400c70 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.751741] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.917 [2024-10-16 07:20:54.751767] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.917 [2024-10-16 07:20:54.751786] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.917 [2024-10-16 07:20:54.751805] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:51.917 [2024-10-16 07:20:54.752646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:51.917 [2024-10-16 07:20:54.752673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:51.917 [2024-10-16 07:20:54.752692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:51.917 [2024-10-16 07:20:54.752708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:51.917 [2024-10-16 07:20:54.752866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.752960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.752986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2298490 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.753003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2298490 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.753030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a3590 (9): Bad file descriptor 00:22:51.917 [2024-10-16 07:20:54.753054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224af70 (9): Bad file descriptor 00:22:51.917 [2024-10-16 07:20:54.753071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2401150 (9): Bad file descriptor 00:22:51.917 [2024-10-16 07:20:54.753088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23fba60 (9): Bad file descriptor 00:22:51.917 [2024-10-16 07:20:54.753105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2400c70 (9): Bad file descriptor 00:22:51.917 [2024-10-16 07:20:54.753250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2276690 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.753379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2276690 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.753489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x226d1b0 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.753608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x226d1b0 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.753692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2411600 with addr=10.0.0.2, port=4420 00:22:51.917 [2024-10-16 07:20:54.753833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2411600 is same with the state(5) to be set 00:22:51.917 [2024-10-16 07:20:54.753913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.917 [2024-10-16 07:20:54.753999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:51.918 [2024-10-16 07:20:54.754023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23ec0a0 with addr=10.0.0.2, port=4420 00:22:51.918 [2024-10-16 07:20:54.754039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23ec0a0 is same with the state(5) to be set 00:22:51.918 [2024-10-16 07:20:54.754056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2298490 (9): Bad file descriptor 00:22:51.918 [2024-10-16 07:20:54.754075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2276690 (9): Bad file descriptor 00:22:51.918 [2024-10-16 07:20:54.754443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x226d1b0 (9): Bad file descriptor 00:22:51.918 [2024-10-16 07:20:54.754461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2411600 (9): Bad file descriptor 00:22:51.918 [2024-10-16 07:20:54.754478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23ec0a0 (9): Bad file descriptor 00:22:51.918 [2024-10-16 07:20:54.754492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:51.918 [2024-10-16 07:20:54.754722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:51.918 [2024-10-16 07:20:54.754746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:51.918 [2024-10-16 07:20:54.754788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:51.918 [2024-10-16 07:20:54.754832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:52.484 07:20:55 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:52.484 07:20:55 -- target/shutdown.sh@138 -- # sleep 1 00:22:53.420 07:20:56 -- target/shutdown.sh@141 -- # kill -9 1969482 00:22:53.420 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1969482) - No such process 00:22:53.420 07:20:56 -- target/shutdown.sh@141 -- # true 00:22:53.420 07:20:56 -- target/shutdown.sh@143 -- # stoptarget 00:22:53.420 07:20:56 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:53.420 07:20:56 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:53.420 07:20:56 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:53.420 07:20:56 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:53.420 07:20:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:53.420 07:20:56 -- nvmf/common.sh@116 -- # sync 00:22:53.420 07:20:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:53.420 07:20:56 -- nvmf/common.sh@119 -- # set +e 00:22:53.420 07:20:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:53.420 07:20:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:53.420 rmmod nvme_tcp 00:22:53.420 rmmod nvme_fabrics 00:22:53.420 rmmod nvme_keyring 00:22:53.420 07:20:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:53.420 07:20:56 -- nvmf/common.sh@123 -- # set -e 00:22:53.420 07:20:56 -- nvmf/common.sh@124 -- # return 0 00:22:53.420 07:20:56 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:53.420 07:20:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:53.420 07:20:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:53.420 07:20:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:53.420 07:20:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:53.420 07:20:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:53.420 07:20:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.420 07:20:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.420 07:20:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.949 07:20:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.949 00:22:55.949 real 0m7.731s 00:22:55.949 user 0m19.232s 00:22:55.949 sys 0m1.328s 00:22:55.949 07:20:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:55.949 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:55.949 ************************************ 00:22:55.949 END TEST nvmf_shutdown_tc3 00:22:55.949 ************************************ 00:22:55.949 07:20:58 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:55.949 00:22:55.949 real 0m28.299s 00:22:55.949 user 1m20.932s 00:22:55.949 sys 0m6.034s 00:22:55.949 07:20:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:55.949 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:55.949 ************************************ 00:22:55.949 END TEST nvmf_shutdown 00:22:55.949 ************************************ 00:22:55.949 07:20:58 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:55.949 07:20:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:55.949 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:55.950 07:20:58 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:55.950 07:20:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:55.950 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:55.950 07:20:58 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:55.950 07:20:58 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:55.950 07:20:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:55.950 07:20:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:55.950 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:55.950 ************************************ 00:22:55.950 START TEST nvmf_multicontroller 00:22:55.950 ************************************ 00:22:55.950 07:20:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:55.950 * Looking for test storage... 00:22:55.950 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:55.950 07:20:58 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.950 07:20:58 -- nvmf/common.sh@7 -- # uname -s 00:22:55.950 07:20:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.950 07:20:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.950 07:20:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.950 07:20:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.950 07:20:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.950 07:20:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.950 07:20:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.950 07:20:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.950 07:20:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.950 07:20:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.950 07:20:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.950 07:20:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.950 07:20:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.950 07:20:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.950 07:20:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.950 07:20:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.950 07:20:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.950 07:20:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.950 07:20:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.950 07:20:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.950 07:20:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.950 07:20:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.950 07:20:58 -- paths/export.sh@5 -- # export PATH 00:22:55.950 07:20:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.950 07:20:58 -- nvmf/common.sh@46 -- # : 0 00:22:55.950 07:20:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.950 07:20:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.950 07:20:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.950 07:20:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.950 07:20:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.950 07:20:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.950 07:20:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.950 07:20:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.950 07:20:58 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:55.950 07:20:58 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:55.950 07:20:58 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:55.950 07:20:58 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:55.950 07:20:58 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:55.950 07:20:58 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:55.950 07:20:58 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:55.950 07:20:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.950 07:20:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.950 07:20:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.950 07:20:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.950 07:20:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.950 07:20:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.950 07:20:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.950 07:20:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.950 07:20:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.950 07:20:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.950 07:20:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.950 07:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:57.850 07:21:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.850 07:21:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.850 07:21:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.850 07:21:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.850 07:21:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.850 07:21:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.850 07:21:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.850 07:21:00 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.850 07:21:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.850 07:21:00 -- nvmf/common.sh@295 -- # e810=() 00:22:57.850 07:21:00 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.850 07:21:00 -- nvmf/common.sh@296 -- # x722=() 00:22:57.850 07:21:00 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.850 07:21:00 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.850 07:21:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.850 07:21:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.850 07:21:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.850 07:21:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.850 07:21:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.850 07:21:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.850 07:21:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.850 07:21:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.850 07:21:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.850 07:21:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.850 07:21:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.850 07:21:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.850 07:21:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.850 07:21:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.850 07:21:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.850 07:21:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.850 07:21:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.850 07:21:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.850 07:21:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.850 07:21:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.850 07:21:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.850 07:21:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.850 07:21:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.850 07:21:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.850 07:21:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.850 07:21:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.850 07:21:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.850 07:21:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.850 07:21:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.850 07:21:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.850 07:21:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.850 07:21:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.850 07:21:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.850 07:21:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.850 07:21:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:22:57.850 00:22:57.850 --- 10.0.0.2 ping statistics --- 00:22:57.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.850 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:22:57.850 07:21:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:57.850 00:22:57.850 --- 10.0.0.1 ping statistics --- 00:22:57.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.850 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:57.850 07:21:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.850 07:21:00 -- nvmf/common.sh@410 -- # return 0 00:22:57.850 07:21:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.850 07:21:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.850 07:21:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.850 07:21:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.850 07:21:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.850 07:21:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.850 07:21:00 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:57.851 07:21:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.851 07:21:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:57.851 07:21:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.851 07:21:00 -- nvmf/common.sh@469 -- # nvmfpid=1971955 00:22:57.851 07:21:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:57.851 07:21:00 -- nvmf/common.sh@470 -- # waitforlisten 1971955 00:22:57.851 07:21:00 -- common/autotest_common.sh@819 -- # '[' -z 1971955 ']' 00:22:57.851 07:21:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.851 07:21:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:57.851 07:21:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.851 07:21:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:57.851 07:21:00 -- common/autotest_common.sh@10 -- # set +x 00:22:57.851 [2024-10-16 07:21:00.752172] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:57.851 [2024-10-16 07:21:00.752255] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.851 EAL: No free 2048 kB hugepages reported on node 1 00:22:58.109 [2024-10-16 07:21:00.822736] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:58.109 [2024-10-16 07:21:00.945228] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:58.109 [2024-10-16 07:21:00.945385] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:58.109 [2024-10-16 07:21:00.945403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:58.109 [2024-10-16 07:21:00.945416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:58.109 [2024-10-16 07:21:00.945469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:58.109 [2024-10-16 07:21:00.945494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:58.109 [2024-10-16 07:21:00.945498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:59.043 07:21:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:59.043 07:21:01 -- common/autotest_common.sh@852 -- # return 0 00:22:59.043 07:21:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:59.043 07:21:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:59.043 07:21:01 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 [2024-10-16 07:21:01.807347] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 Malloc0 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 [2024-10-16 07:21:01.868789] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 [2024-10-16 07:21:01.876651] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 Malloc1 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:59.043 07:21:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.043 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:59.043 07:21:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.043 07:21:01 -- host/multicontroller.sh@44 -- # bdevperf_pid=1972180 00:22:59.043 07:21:01 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:59.043 07:21:01 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:59.043 07:21:01 -- host/multicontroller.sh@47 -- # waitforlisten 1972180 /var/tmp/bdevperf.sock 00:22:59.043 07:21:01 -- common/autotest_common.sh@819 -- # '[' -z 1972180 ']' 00:22:59.043 07:21:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:59.044 07:21:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:59.044 07:21:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:59.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:59.044 07:21:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:59.044 07:21:01 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 07:21:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:00.417 07:21:02 -- common/autotest_common.sh@852 -- # return 0 00:23:00.417 07:21:02 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:00.417 07:21:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.417 07:21:02 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 NVMe0n1 00:23:00.417 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.417 07:21:03 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:00.417 07:21:03 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:00.417 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.417 1 00:23:00.417 07:21:03 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.417 07:21:03 -- common/autotest_common.sh@640 -- # local es=0 00:23:00.417 07:21:03 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.417 07:21:03 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:00.417 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 request: 00:23:00.417 { 00:23:00.417 "name": "NVMe0", 00:23:00.417 "trtype": "tcp", 00:23:00.417 "traddr": "10.0.0.2", 00:23:00.417 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:00.417 "hostaddr": "10.0.0.2", 00:23:00.417 "hostsvcid": "60000", 00:23:00.417 "adrfam": "ipv4", 00:23:00.417 "trsvcid": "4420", 00:23:00.417 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.417 "method": "bdev_nvme_attach_controller", 00:23:00.417 "req_id": 1 00:23:00.417 } 00:23:00.417 Got JSON-RPC error response 00:23:00.417 response: 00:23:00.417 { 00:23:00.417 "code": -114, 00:23:00.417 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.417 } 00:23:00.417 07:21:03 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:00.417 07:21:03 -- common/autotest_common.sh@643 -- # es=1 00:23:00.417 07:21:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:00.417 07:21:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:00.417 07:21:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:00.417 07:21:03 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.417 07:21:03 -- common/autotest_common.sh@640 -- # local es=0 00:23:00.417 07:21:03 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.417 07:21:03 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:00.417 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 request: 00:23:00.417 { 00:23:00.417 "name": "NVMe0", 00:23:00.417 "trtype": "tcp", 00:23:00.417 "traddr": "10.0.0.2", 00:23:00.417 "hostaddr": "10.0.0.2", 00:23:00.417 "hostsvcid": "60000", 00:23:00.417 "adrfam": "ipv4", 00:23:00.417 "trsvcid": "4420", 00:23:00.417 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:00.417 "method": "bdev_nvme_attach_controller", 00:23:00.417 "req_id": 1 00:23:00.417 } 00:23:00.417 Got JSON-RPC error response 00:23:00.417 response: 00:23:00.417 { 00:23:00.417 "code": -114, 00:23:00.417 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.417 } 00:23:00.417 07:21:03 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:00.417 07:21:03 -- common/autotest_common.sh@643 -- # es=1 00:23:00.417 07:21:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:00.417 07:21:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:00.417 07:21:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:00.417 07:21:03 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@640 -- # local es=0 00:23:00.417 07:21:03 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:00.417 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.417 07:21:03 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.417 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.417 request: 00:23:00.417 { 00:23:00.417 "name": "NVMe0", 00:23:00.417 "trtype": "tcp", 00:23:00.417 "traddr": "10.0.0.2", 00:23:00.417 "hostaddr": "10.0.0.2", 00:23:00.417 "hostsvcid": "60000", 00:23:00.417 "adrfam": "ipv4", 00:23:00.417 "trsvcid": "4420", 00:23:00.417 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.417 "multipath": "disable", 00:23:00.417 "method": "bdev_nvme_attach_controller", 00:23:00.417 "req_id": 1 00:23:00.417 } 00:23:00.418 Got JSON-RPC error response 00:23:00.418 response: 00:23:00.418 { 00:23:00.418 "code": -114, 00:23:00.418 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:00.418 } 00:23:00.418 07:21:03 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:00.418 07:21:03 -- common/autotest_common.sh@643 -- # es=1 00:23:00.418 07:21:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:00.418 07:21:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:00.418 07:21:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:00.418 07:21:03 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.418 07:21:03 -- common/autotest_common.sh@640 -- # local es=0 00:23:00.418 07:21:03 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.418 07:21:03 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:23:00.418 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.418 07:21:03 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:23:00.418 07:21:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:23:00.418 07:21:03 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:00.418 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.418 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.418 request: 00:23:00.418 { 00:23:00.418 "name": "NVMe0", 00:23:00.418 "trtype": "tcp", 00:23:00.418 "traddr": "10.0.0.2", 00:23:00.418 "hostaddr": "10.0.0.2", 00:23:00.418 "hostsvcid": "60000", 00:23:00.418 "adrfam": "ipv4", 00:23:00.418 "trsvcid": "4420", 00:23:00.418 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:00.418 "multipath": "failover", 00:23:00.418 "method": "bdev_nvme_attach_controller", 00:23:00.418 "req_id": 1 00:23:00.418 } 00:23:00.418 Got JSON-RPC error response 00:23:00.418 response: 00:23:00.418 { 00:23:00.418 "code": -114, 00:23:00.418 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:00.418 } 00:23:00.418 07:21:03 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:23:00.418 07:21:03 -- common/autotest_common.sh@643 -- # es=1 00:23:00.418 07:21:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:23:00.418 07:21:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:23:00.418 07:21:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:23:00.418 07:21:03 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:00.418 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.418 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.675 00:23:00.675 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.675 07:21:03 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:00.675 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.675 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.675 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.675 07:21:03 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:00.675 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.675 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.675 00:23:00.675 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.675 07:21:03 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:00.675 07:21:03 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:00.675 07:21:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:00.675 07:21:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.675 07:21:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:00.675 07:21:03 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:00.675 07:21:03 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:02.049 0 00:23:02.049 07:21:04 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:02.049 07:21:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:02.049 07:21:04 -- common/autotest_common.sh@10 -- # set +x 00:23:02.049 07:21:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:02.049 07:21:04 -- host/multicontroller.sh@100 -- # killprocess 1972180 00:23:02.049 07:21:04 -- common/autotest_common.sh@926 -- # '[' -z 1972180 ']' 00:23:02.049 07:21:04 -- common/autotest_common.sh@930 -- # kill -0 1972180 00:23:02.049 07:21:04 -- common/autotest_common.sh@931 -- # uname 00:23:02.049 07:21:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:02.049 07:21:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1972180 00:23:02.049 07:21:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:02.049 07:21:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:02.049 07:21:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1972180' 00:23:02.049 killing process with pid 1972180 00:23:02.049 07:21:04 -- common/autotest_common.sh@945 -- # kill 1972180 00:23:02.049 07:21:04 -- common/autotest_common.sh@950 -- # wait 1972180 00:23:02.307 07:21:05 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:02.308 07:21:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:02.308 07:21:05 -- common/autotest_common.sh@10 -- # set +x 00:23:02.308 07:21:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:02.308 07:21:05 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:02.308 07:21:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:02.308 07:21:05 -- common/autotest_common.sh@10 -- # set +x 00:23:02.308 07:21:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:02.308 07:21:05 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:02.308 07:21:05 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:02.308 07:21:05 -- common/autotest_common.sh@1597 -- # read -r file 00:23:02.308 07:21:05 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:02.308 07:21:05 -- common/autotest_common.sh@1596 -- # sort -u 00:23:02.308 07:21:05 -- common/autotest_common.sh@1598 -- # cat 00:23:02.308 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:02.308 [2024-10-16 07:21:01.972420] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:02.308 [2024-10-16 07:21:01.972511] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1972180 ] 00:23:02.308 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.308 [2024-10-16 07:21:02.032846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:02.308 [2024-10-16 07:21:02.140351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:02.308 [2024-10-16 07:21:03.548286] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name ca4d3d6d-58f8-48b4-9977-a2ddba8b8895 already exists 00:23:02.308 [2024-10-16 07:21:03.548324] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:ca4d3d6d-58f8-48b4-9977-a2ddba8b8895 alias for bdev NVMe1n1 00:23:02.308 [2024-10-16 07:21:03.548357] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:02.308 Running I/O for 1 seconds... 00:23:02.308 00:23:02.308 Latency(us) 00:23:02.308 [2024-10-16T05:21:05.248Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:02.308 [2024-10-16T05:21:05.248Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:02.308 NVMe0n1 : 1.01 19582.96 76.50 0.00 0.00 6525.91 2718.53 12087.75 00:23:02.308 [2024-10-16T05:21:05.248Z] =================================================================================================================== 00:23:02.308 [2024-10-16T05:21:05.248Z] Total : 19582.96 76.50 0.00 0.00 6525.91 2718.53 12087.75 00:23:02.308 Received shutdown signal, test time was about 1.000000 seconds 00:23:02.308 00:23:02.308 Latency(us) 00:23:02.308 [2024-10-16T05:21:05.248Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:02.308 [2024-10-16T05:21:05.248Z] =================================================================================================================== 00:23:02.308 [2024-10-16T05:21:05.248Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:02.308 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:02.308 07:21:05 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:02.308 07:21:05 -- common/autotest_common.sh@1597 -- # read -r file 00:23:02.308 07:21:05 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:02.308 07:21:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:02.308 07:21:05 -- nvmf/common.sh@116 -- # sync 00:23:02.308 07:21:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:02.308 07:21:05 -- nvmf/common.sh@119 -- # set +e 00:23:02.308 07:21:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:02.308 07:21:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:02.308 rmmod nvme_tcp 00:23:02.308 rmmod nvme_fabrics 00:23:02.308 rmmod nvme_keyring 00:23:02.308 07:21:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:02.308 07:21:05 -- nvmf/common.sh@123 -- # set -e 00:23:02.308 07:21:05 -- nvmf/common.sh@124 -- # return 0 00:23:02.308 07:21:05 -- nvmf/common.sh@477 -- # '[' -n 1971955 ']' 00:23:02.308 07:21:05 -- nvmf/common.sh@478 -- # killprocess 1971955 00:23:02.308 07:21:05 -- common/autotest_common.sh@926 -- # '[' -z 1971955 ']' 00:23:02.308 07:21:05 -- common/autotest_common.sh@930 -- # kill -0 1971955 00:23:02.308 07:21:05 -- common/autotest_common.sh@931 -- # uname 00:23:02.308 07:21:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:02.308 07:21:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1971955 00:23:02.308 07:21:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:23:02.308 07:21:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:23:02.308 07:21:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1971955' 00:23:02.308 killing process with pid 1971955 00:23:02.308 07:21:05 -- common/autotest_common.sh@945 -- # kill 1971955 00:23:02.308 07:21:05 -- common/autotest_common.sh@950 -- # wait 1971955 00:23:02.566 07:21:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:02.566 07:21:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:02.566 07:21:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:02.566 07:21:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:02.566 07:21:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:02.566 07:21:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:02.566 07:21:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:02.566 07:21:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:05.096 07:21:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:05.096 00:23:05.096 real 0m9.058s 00:23:05.096 user 0m17.767s 00:23:05.096 sys 0m2.373s 00:23:05.096 07:21:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:05.096 07:21:07 -- common/autotest_common.sh@10 -- # set +x 00:23:05.096 ************************************ 00:23:05.096 END TEST nvmf_multicontroller 00:23:05.096 ************************************ 00:23:05.096 07:21:07 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:05.096 07:21:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:05.096 07:21:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:05.096 07:21:07 -- common/autotest_common.sh@10 -- # set +x 00:23:05.096 ************************************ 00:23:05.096 START TEST nvmf_aer 00:23:05.096 ************************************ 00:23:05.096 07:21:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:05.096 * Looking for test storage... 00:23:05.096 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:05.096 07:21:07 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:05.096 07:21:07 -- nvmf/common.sh@7 -- # uname -s 00:23:05.096 07:21:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:05.096 07:21:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:05.096 07:21:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:05.096 07:21:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:05.096 07:21:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:05.096 07:21:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:05.096 07:21:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:05.096 07:21:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:05.096 07:21:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:05.096 07:21:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:05.096 07:21:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:05.096 07:21:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:05.096 07:21:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:05.096 07:21:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:05.096 07:21:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:05.096 07:21:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:05.096 07:21:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:05.096 07:21:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:05.096 07:21:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:05.096 07:21:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.096 07:21:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.096 07:21:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.096 07:21:07 -- paths/export.sh@5 -- # export PATH 00:23:05.097 07:21:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.097 07:21:07 -- nvmf/common.sh@46 -- # : 0 00:23:05.097 07:21:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:05.097 07:21:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:05.097 07:21:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:05.097 07:21:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:05.097 07:21:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:05.097 07:21:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:05.097 07:21:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:05.097 07:21:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:05.097 07:21:07 -- host/aer.sh@11 -- # nvmftestinit 00:23:05.097 07:21:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:05.097 07:21:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:05.097 07:21:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:05.097 07:21:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:05.097 07:21:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:05.097 07:21:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.097 07:21:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.097 07:21:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:05.097 07:21:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:05.097 07:21:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:05.097 07:21:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:05.097 07:21:07 -- common/autotest_common.sh@10 -- # set +x 00:23:07.003 07:21:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:07.003 07:21:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:07.003 07:21:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:07.003 07:21:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:07.003 07:21:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:07.003 07:21:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:07.003 07:21:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:07.003 07:21:09 -- nvmf/common.sh@294 -- # net_devs=() 00:23:07.003 07:21:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:07.003 07:21:09 -- nvmf/common.sh@295 -- # e810=() 00:23:07.003 07:21:09 -- nvmf/common.sh@295 -- # local -ga e810 00:23:07.003 07:21:09 -- nvmf/common.sh@296 -- # x722=() 00:23:07.003 07:21:09 -- nvmf/common.sh@296 -- # local -ga x722 00:23:07.003 07:21:09 -- nvmf/common.sh@297 -- # mlx=() 00:23:07.003 07:21:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:07.003 07:21:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:07.003 07:21:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:07.003 07:21:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:07.004 07:21:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:07.004 07:21:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:07.004 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:07.004 07:21:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:07.004 07:21:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:07.004 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:07.004 07:21:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:07.004 07:21:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:07.004 07:21:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:07.004 07:21:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:07.004 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:07.004 07:21:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:07.004 07:21:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:07.004 07:21:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:07.004 07:21:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:07.004 07:21:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:07.004 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:07.004 07:21:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:07.004 07:21:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:07.004 07:21:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:07.004 07:21:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:07.004 07:21:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:07.004 07:21:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:07.004 07:21:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:07.004 07:21:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:07.004 07:21:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:07.004 07:21:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:07.004 07:21:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:07.004 07:21:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:07.004 07:21:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:07.004 07:21:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:07.004 07:21:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:07.004 07:21:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:07.004 07:21:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:07.004 07:21:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:07.004 07:21:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:07.004 07:21:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:07.004 07:21:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:07.004 07:21:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:07.004 07:21:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:07.004 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:07.004 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:23:07.004 00:23:07.004 --- 10.0.0.2 ping statistics --- 00:23:07.004 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:07.004 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:23:07.004 07:21:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:07.004 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:07.004 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:23:07.004 00:23:07.004 --- 10.0.0.1 ping statistics --- 00:23:07.004 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:07.004 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:23:07.004 07:21:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:07.004 07:21:09 -- nvmf/common.sh@410 -- # return 0 00:23:07.004 07:21:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:07.004 07:21:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:07.004 07:21:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:07.004 07:21:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:07.004 07:21:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:07.004 07:21:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:07.004 07:21:09 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:07.004 07:21:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:07.004 07:21:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:07.004 07:21:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.004 07:21:09 -- nvmf/common.sh@469 -- # nvmfpid=1975041 00:23:07.004 07:21:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:07.004 07:21:09 -- nvmf/common.sh@470 -- # waitforlisten 1975041 00:23:07.004 07:21:09 -- common/autotest_common.sh@819 -- # '[' -z 1975041 ']' 00:23:07.004 07:21:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:07.004 07:21:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:07.004 07:21:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:07.004 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:07.004 07:21:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:07.004 07:21:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.004 [2024-10-16 07:21:09.669853] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:07.004 [2024-10-16 07:21:09.669919] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:07.004 EAL: No free 2048 kB hugepages reported on node 1 00:23:07.004 [2024-10-16 07:21:09.738622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:07.004 [2024-10-16 07:21:09.862836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:07.004 [2024-10-16 07:21:09.862998] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:07.004 [2024-10-16 07:21:09.863016] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:07.004 [2024-10-16 07:21:09.863028] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:07.004 [2024-10-16 07:21:09.863094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:07.004 [2024-10-16 07:21:09.863124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:07.004 [2024-10-16 07:21:09.863150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:07.004 [2024-10-16 07:21:09.863153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:07.938 07:21:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:07.938 07:21:10 -- common/autotest_common.sh@852 -- # return 0 00:23:07.938 07:21:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:07.938 07:21:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 07:21:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:07.938 07:21:10 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 [2024-10-16 07:21:10.720435] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 Malloc0 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 [2024-10-16 07:21:10.771470] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:07.938 07:21:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.938 07:21:10 -- common/autotest_common.sh@10 -- # set +x 00:23:07.938 [2024-10-16 07:21:10.779234] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:07.938 [ 00:23:07.938 { 00:23:07.938 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:07.938 "subtype": "Discovery", 00:23:07.938 "listen_addresses": [], 00:23:07.938 "allow_any_host": true, 00:23:07.938 "hosts": [] 00:23:07.938 }, 00:23:07.938 { 00:23:07.938 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:07.938 "subtype": "NVMe", 00:23:07.938 "listen_addresses": [ 00:23:07.938 { 00:23:07.938 "transport": "TCP", 00:23:07.938 "trtype": "TCP", 00:23:07.938 "adrfam": "IPv4", 00:23:07.938 "traddr": "10.0.0.2", 00:23:07.938 "trsvcid": "4420" 00:23:07.938 } 00:23:07.938 ], 00:23:07.938 "allow_any_host": true, 00:23:07.938 "hosts": [], 00:23:07.938 "serial_number": "SPDK00000000000001", 00:23:07.938 "model_number": "SPDK bdev Controller", 00:23:07.938 "max_namespaces": 2, 00:23:07.938 "min_cntlid": 1, 00:23:07.938 "max_cntlid": 65519, 00:23:07.938 "namespaces": [ 00:23:07.938 { 00:23:07.938 "nsid": 1, 00:23:07.938 "bdev_name": "Malloc0", 00:23:07.938 "name": "Malloc0", 00:23:07.938 "nguid": "DB6ED9A556B445269F90FB885E5272DB", 00:23:07.938 "uuid": "db6ed9a5-56b4-4526-9f90-fb885e5272db" 00:23:07.938 } 00:23:07.938 ] 00:23:07.938 } 00:23:07.938 ] 00:23:07.938 07:21:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.938 07:21:10 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:07.938 07:21:10 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:07.938 07:21:10 -- host/aer.sh@33 -- # aerpid=1975206 00:23:07.938 07:21:10 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:07.938 07:21:10 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:07.938 07:21:10 -- common/autotest_common.sh@1244 -- # local i=0 00:23:07.938 07:21:10 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:07.938 07:21:10 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:23:07.938 07:21:10 -- common/autotest_common.sh@1247 -- # i=1 00:23:07.938 07:21:10 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:23:07.938 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.196 07:21:10 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.196 07:21:10 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:23:08.196 07:21:10 -- common/autotest_common.sh@1247 -- # i=2 00:23:08.196 07:21:10 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:23:08.196 07:21:10 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.196 07:21:10 -- common/autotest_common.sh@1246 -- # '[' 2 -lt 200 ']' 00:23:08.196 07:21:10 -- common/autotest_common.sh@1247 -- # i=3 00:23:08.196 07:21:10 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:23:08.196 07:21:11 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.196 07:21:11 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:08.196 07:21:11 -- common/autotest_common.sh@1255 -- # return 0 00:23:08.196 07:21:11 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:08.196 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.196 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.196 Malloc1 00:23:08.196 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.454 07:21:11 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:08.454 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.454 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.454 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.454 07:21:11 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:08.454 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.454 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.454 Asynchronous Event Request test 00:23:08.454 Attaching to 10.0.0.2 00:23:08.454 Attached to 10.0.0.2 00:23:08.454 Registering asynchronous event callbacks... 00:23:08.454 Starting namespace attribute notice tests for all controllers... 00:23:08.454 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:08.454 aer_cb - Changed Namespace 00:23:08.454 Cleaning up... 00:23:08.454 [ 00:23:08.454 { 00:23:08.454 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:08.454 "subtype": "Discovery", 00:23:08.454 "listen_addresses": [], 00:23:08.455 "allow_any_host": true, 00:23:08.455 "hosts": [] 00:23:08.455 }, 00:23:08.455 { 00:23:08.455 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:08.455 "subtype": "NVMe", 00:23:08.455 "listen_addresses": [ 00:23:08.455 { 00:23:08.455 "transport": "TCP", 00:23:08.455 "trtype": "TCP", 00:23:08.455 "adrfam": "IPv4", 00:23:08.455 "traddr": "10.0.0.2", 00:23:08.455 "trsvcid": "4420" 00:23:08.455 } 00:23:08.455 ], 00:23:08.455 "allow_any_host": true, 00:23:08.455 "hosts": [], 00:23:08.455 "serial_number": "SPDK00000000000001", 00:23:08.455 "model_number": "SPDK bdev Controller", 00:23:08.455 "max_namespaces": 2, 00:23:08.455 "min_cntlid": 1, 00:23:08.455 "max_cntlid": 65519, 00:23:08.455 "namespaces": [ 00:23:08.455 { 00:23:08.455 "nsid": 1, 00:23:08.455 "bdev_name": "Malloc0", 00:23:08.455 "name": "Malloc0", 00:23:08.455 "nguid": "DB6ED9A556B445269F90FB885E5272DB", 00:23:08.455 "uuid": "db6ed9a5-56b4-4526-9f90-fb885e5272db" 00:23:08.455 }, 00:23:08.455 { 00:23:08.455 "nsid": 2, 00:23:08.455 "bdev_name": "Malloc1", 00:23:08.455 "name": "Malloc1", 00:23:08.455 "nguid": "0ECCE4702F3C4D98A6103CA9B2569D46", 00:23:08.455 "uuid": "0ecce470-2f3c-4d98-a610-3ca9b2569d46" 00:23:08.455 } 00:23:08.455 ] 00:23:08.455 } 00:23:08.455 ] 00:23:08.455 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.455 07:21:11 -- host/aer.sh@43 -- # wait 1975206 00:23:08.455 07:21:11 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:08.455 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.455 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.455 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.455 07:21:11 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:08.455 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.455 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.455 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.455 07:21:11 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:08.455 07:21:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:08.455 07:21:11 -- common/autotest_common.sh@10 -- # set +x 00:23:08.455 07:21:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:08.455 07:21:11 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:08.455 07:21:11 -- host/aer.sh@51 -- # nvmftestfini 00:23:08.455 07:21:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:08.455 07:21:11 -- nvmf/common.sh@116 -- # sync 00:23:08.455 07:21:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:08.455 07:21:11 -- nvmf/common.sh@119 -- # set +e 00:23:08.455 07:21:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:08.455 07:21:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:08.455 rmmod nvme_tcp 00:23:08.455 rmmod nvme_fabrics 00:23:08.455 rmmod nvme_keyring 00:23:08.455 07:21:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:08.455 07:21:11 -- nvmf/common.sh@123 -- # set -e 00:23:08.455 07:21:11 -- nvmf/common.sh@124 -- # return 0 00:23:08.455 07:21:11 -- nvmf/common.sh@477 -- # '[' -n 1975041 ']' 00:23:08.455 07:21:11 -- nvmf/common.sh@478 -- # killprocess 1975041 00:23:08.455 07:21:11 -- common/autotest_common.sh@926 -- # '[' -z 1975041 ']' 00:23:08.455 07:21:11 -- common/autotest_common.sh@930 -- # kill -0 1975041 00:23:08.455 07:21:11 -- common/autotest_common.sh@931 -- # uname 00:23:08.455 07:21:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:08.455 07:21:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1975041 00:23:08.455 07:21:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:08.455 07:21:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:08.455 07:21:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1975041' 00:23:08.455 killing process with pid 1975041 00:23:08.455 07:21:11 -- common/autotest_common.sh@945 -- # kill 1975041 00:23:08.455 [2024-10-16 07:21:11.347931] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:08.455 07:21:11 -- common/autotest_common.sh@950 -- # wait 1975041 00:23:08.713 07:21:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:08.713 07:21:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:08.713 07:21:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:08.713 07:21:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:08.713 07:21:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:08.713 07:21:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.713 07:21:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.713 07:21:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.245 07:21:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:11.245 00:23:11.245 real 0m6.142s 00:23:11.245 user 0m7.666s 00:23:11.245 sys 0m1.935s 00:23:11.245 07:21:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:11.245 07:21:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.245 ************************************ 00:23:11.245 END TEST nvmf_aer 00:23:11.245 ************************************ 00:23:11.245 07:21:13 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:11.245 07:21:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:11.245 07:21:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:11.245 07:21:13 -- common/autotest_common.sh@10 -- # set +x 00:23:11.245 ************************************ 00:23:11.245 START TEST nvmf_async_init 00:23:11.245 ************************************ 00:23:11.245 07:21:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:11.245 * Looking for test storage... 00:23:11.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:11.245 07:21:13 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:11.245 07:21:13 -- nvmf/common.sh@7 -- # uname -s 00:23:11.245 07:21:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:11.245 07:21:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:11.245 07:21:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:11.245 07:21:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:11.245 07:21:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:11.245 07:21:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:11.245 07:21:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:11.245 07:21:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:11.245 07:21:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:11.245 07:21:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:11.245 07:21:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.245 07:21:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.245 07:21:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:11.245 07:21:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:11.245 07:21:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:11.245 07:21:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:11.245 07:21:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:11.245 07:21:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:11.245 07:21:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:11.245 07:21:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.245 07:21:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.245 07:21:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.245 07:21:13 -- paths/export.sh@5 -- # export PATH 00:23:11.245 07:21:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.245 07:21:13 -- nvmf/common.sh@46 -- # : 0 00:23:11.245 07:21:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:11.245 07:21:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:11.245 07:21:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:11.245 07:21:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:11.245 07:21:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:11.245 07:21:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:11.245 07:21:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:11.245 07:21:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:11.245 07:21:13 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:11.245 07:21:13 -- host/async_init.sh@14 -- # null_block_size=512 00:23:11.245 07:21:13 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:11.245 07:21:13 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:11.245 07:21:13 -- host/async_init.sh@20 -- # uuidgen 00:23:11.245 07:21:13 -- host/async_init.sh@20 -- # tr -d - 00:23:11.245 07:21:13 -- host/async_init.sh@20 -- # nguid=3969eaff2e584a9aa08d826d6957fc74 00:23:11.245 07:21:13 -- host/async_init.sh@22 -- # nvmftestinit 00:23:11.245 07:21:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:11.245 07:21:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:11.245 07:21:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:11.245 07:21:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:11.245 07:21:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:11.245 07:21:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.245 07:21:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.245 07:21:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.245 07:21:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:11.245 07:21:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:11.245 07:21:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:11.245 07:21:13 -- common/autotest_common.sh@10 -- # set +x 00:23:13.146 07:21:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:13.146 07:21:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:13.146 07:21:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:13.146 07:21:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:13.146 07:21:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:13.146 07:21:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:13.146 07:21:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:13.146 07:21:15 -- nvmf/common.sh@294 -- # net_devs=() 00:23:13.146 07:21:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:13.146 07:21:15 -- nvmf/common.sh@295 -- # e810=() 00:23:13.146 07:21:15 -- nvmf/common.sh@295 -- # local -ga e810 00:23:13.146 07:21:15 -- nvmf/common.sh@296 -- # x722=() 00:23:13.146 07:21:15 -- nvmf/common.sh@296 -- # local -ga x722 00:23:13.146 07:21:15 -- nvmf/common.sh@297 -- # mlx=() 00:23:13.146 07:21:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:13.146 07:21:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:13.146 07:21:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:13.146 07:21:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:13.146 07:21:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:13.146 07:21:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.146 07:21:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:13.146 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:13.146 07:21:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.146 07:21:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:13.146 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:13.146 07:21:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:13.146 07:21:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.146 07:21:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.146 07:21:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.146 07:21:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.146 07:21:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:13.146 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:13.146 07:21:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.146 07:21:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.146 07:21:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.146 07:21:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.146 07:21:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.146 07:21:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:13.146 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:13.146 07:21:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.146 07:21:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:13.146 07:21:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:13.146 07:21:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:13.146 07:21:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:13.146 07:21:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:13.146 07:21:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:13.147 07:21:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:13.147 07:21:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:13.147 07:21:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:13.147 07:21:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:13.147 07:21:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:13.147 07:21:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:13.147 07:21:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:13.147 07:21:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:13.147 07:21:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:13.147 07:21:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:13.147 07:21:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:13.147 07:21:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:13.147 07:21:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:13.147 07:21:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:13.147 07:21:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:13.147 07:21:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:13.147 07:21:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:13.147 07:21:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:13.147 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:13.147 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:23:13.147 00:23:13.147 --- 10.0.0.2 ping statistics --- 00:23:13.147 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.147 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:23:13.147 07:21:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:13.147 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:13.147 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:23:13.147 00:23:13.147 --- 10.0.0.1 ping statistics --- 00:23:13.147 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.147 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:23:13.147 07:21:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:13.147 07:21:15 -- nvmf/common.sh@410 -- # return 0 00:23:13.147 07:21:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:13.147 07:21:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:13.147 07:21:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:13.147 07:21:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:13.147 07:21:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:13.147 07:21:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:13.147 07:21:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:13.147 07:21:15 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:13.147 07:21:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:13.147 07:21:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:13.147 07:21:15 -- common/autotest_common.sh@10 -- # set +x 00:23:13.147 07:21:15 -- nvmf/common.sh@469 -- # nvmfpid=1977155 00:23:13.147 07:21:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:13.147 07:21:15 -- nvmf/common.sh@470 -- # waitforlisten 1977155 00:23:13.147 07:21:15 -- common/autotest_common.sh@819 -- # '[' -z 1977155 ']' 00:23:13.147 07:21:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:13.147 07:21:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:13.147 07:21:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:13.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:13.147 07:21:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:13.147 07:21:15 -- common/autotest_common.sh@10 -- # set +x 00:23:13.147 [2024-10-16 07:21:16.040119] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:13.147 [2024-10-16 07:21:16.040196] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:13.147 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.405 [2024-10-16 07:21:16.113210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:13.405 [2024-10-16 07:21:16.229580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:13.405 [2024-10-16 07:21:16.229744] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:13.405 [2024-10-16 07:21:16.229764] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:13.405 [2024-10-16 07:21:16.229777] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:13.405 [2024-10-16 07:21:16.229803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:14.339 07:21:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:14.339 07:21:16 -- common/autotest_common.sh@852 -- # return 0 00:23:14.339 07:21:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:14.339 07:21:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:14.339 07:21:16 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 07:21:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:14.339 07:21:17 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 [2024-10-16 07:21:17.021281] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 null0 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 3969eaff2e584a9aa08d826d6957fc74 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.339 [2024-10-16 07:21:17.061547] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:14.339 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.339 07:21:17 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:14.339 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.339 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 nvme0n1 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 [ 00:23:14.598 { 00:23:14.598 "name": "nvme0n1", 00:23:14.598 "aliases": [ 00:23:14.598 "3969eaff-2e58-4a9a-a08d-826d6957fc74" 00:23:14.598 ], 00:23:14.598 "product_name": "NVMe disk", 00:23:14.598 "block_size": 512, 00:23:14.598 "num_blocks": 2097152, 00:23:14.598 "uuid": "3969eaff-2e58-4a9a-a08d-826d6957fc74", 00:23:14.598 "assigned_rate_limits": { 00:23:14.598 "rw_ios_per_sec": 0, 00:23:14.598 "rw_mbytes_per_sec": 0, 00:23:14.598 "r_mbytes_per_sec": 0, 00:23:14.598 "w_mbytes_per_sec": 0 00:23:14.598 }, 00:23:14.598 "claimed": false, 00:23:14.598 "zoned": false, 00:23:14.598 "supported_io_types": { 00:23:14.598 "read": true, 00:23:14.598 "write": true, 00:23:14.598 "unmap": false, 00:23:14.598 "write_zeroes": true, 00:23:14.598 "flush": true, 00:23:14.598 "reset": true, 00:23:14.598 "compare": true, 00:23:14.598 "compare_and_write": true, 00:23:14.598 "abort": true, 00:23:14.598 "nvme_admin": true, 00:23:14.598 "nvme_io": true 00:23:14.598 }, 00:23:14.598 "driver_specific": { 00:23:14.598 "nvme": [ 00:23:14.598 { 00:23:14.598 "trid": { 00:23:14.598 "trtype": "TCP", 00:23:14.598 "adrfam": "IPv4", 00:23:14.598 "traddr": "10.0.0.2", 00:23:14.598 "trsvcid": "4420", 00:23:14.598 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.598 }, 00:23:14.598 "ctrlr_data": { 00:23:14.598 "cntlid": 1, 00:23:14.598 "vendor_id": "0x8086", 00:23:14.598 "model_number": "SPDK bdev Controller", 00:23:14.598 "serial_number": "00000000000000000000", 00:23:14.598 "firmware_revision": "24.01.1", 00:23:14.598 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.598 "oacs": { 00:23:14.598 "security": 0, 00:23:14.598 "format": 0, 00:23:14.598 "firmware": 0, 00:23:14.598 "ns_manage": 0 00:23:14.598 }, 00:23:14.598 "multi_ctrlr": true, 00:23:14.598 "ana_reporting": false 00:23:14.598 }, 00:23:14.598 "vs": { 00:23:14.598 "nvme_version": "1.3" 00:23:14.598 }, 00:23:14.598 "ns_data": { 00:23:14.598 "id": 1, 00:23:14.598 "can_share": true 00:23:14.598 } 00:23:14.598 } 00:23:14.598 ], 00:23:14.598 "mp_policy": "active_passive" 00:23:14.598 } 00:23:14.598 } 00:23:14.598 ] 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 [2024-10-16 07:21:17.310159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:14.598 [2024-10-16 07:21:17.310248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x148fba0 (9): Bad file descriptor 00:23:14.598 [2024-10-16 07:21:17.442893] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 [ 00:23:14.598 { 00:23:14.598 "name": "nvme0n1", 00:23:14.598 "aliases": [ 00:23:14.598 "3969eaff-2e58-4a9a-a08d-826d6957fc74" 00:23:14.598 ], 00:23:14.598 "product_name": "NVMe disk", 00:23:14.598 "block_size": 512, 00:23:14.598 "num_blocks": 2097152, 00:23:14.598 "uuid": "3969eaff-2e58-4a9a-a08d-826d6957fc74", 00:23:14.598 "assigned_rate_limits": { 00:23:14.598 "rw_ios_per_sec": 0, 00:23:14.598 "rw_mbytes_per_sec": 0, 00:23:14.598 "r_mbytes_per_sec": 0, 00:23:14.598 "w_mbytes_per_sec": 0 00:23:14.598 }, 00:23:14.598 "claimed": false, 00:23:14.598 "zoned": false, 00:23:14.598 "supported_io_types": { 00:23:14.598 "read": true, 00:23:14.598 "write": true, 00:23:14.598 "unmap": false, 00:23:14.598 "write_zeroes": true, 00:23:14.598 "flush": true, 00:23:14.598 "reset": true, 00:23:14.598 "compare": true, 00:23:14.598 "compare_and_write": true, 00:23:14.598 "abort": true, 00:23:14.598 "nvme_admin": true, 00:23:14.598 "nvme_io": true 00:23:14.598 }, 00:23:14.598 "driver_specific": { 00:23:14.598 "nvme": [ 00:23:14.598 { 00:23:14.598 "trid": { 00:23:14.598 "trtype": "TCP", 00:23:14.598 "adrfam": "IPv4", 00:23:14.598 "traddr": "10.0.0.2", 00:23:14.598 "trsvcid": "4420", 00:23:14.598 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.598 }, 00:23:14.598 "ctrlr_data": { 00:23:14.598 "cntlid": 2, 00:23:14.598 "vendor_id": "0x8086", 00:23:14.598 "model_number": "SPDK bdev Controller", 00:23:14.598 "serial_number": "00000000000000000000", 00:23:14.598 "firmware_revision": "24.01.1", 00:23:14.598 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.598 "oacs": { 00:23:14.598 "security": 0, 00:23:14.598 "format": 0, 00:23:14.598 "firmware": 0, 00:23:14.598 "ns_manage": 0 00:23:14.598 }, 00:23:14.598 "multi_ctrlr": true, 00:23:14.598 "ana_reporting": false 00:23:14.598 }, 00:23:14.598 "vs": { 00:23:14.598 "nvme_version": "1.3" 00:23:14.598 }, 00:23:14.598 "ns_data": { 00:23:14.598 "id": 1, 00:23:14.598 "can_share": true 00:23:14.598 } 00:23:14.598 } 00:23:14.598 ], 00:23:14.598 "mp_policy": "active_passive" 00:23:14.598 } 00:23:14.598 } 00:23:14.598 ] 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@53 -- # mktemp 00:23:14.598 07:21:17 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.sdjGMstjJ4 00:23:14.598 07:21:17 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:14.598 07:21:17 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.sdjGMstjJ4 00:23:14.598 07:21:17 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 [2024-10-16 07:21:17.490807] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:14.598 [2024-10-16 07:21:17.490943] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.598 07:21:17 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.sdjGMstjJ4 00:23:14.598 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.598 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.598 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.599 07:21:17 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.sdjGMstjJ4 00:23:14.599 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.599 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.599 [2024-10-16 07:21:17.506840] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:14.857 nvme0n1 00:23:14.857 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.857 07:21:17 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:14.857 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.857 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.857 [ 00:23:14.857 { 00:23:14.857 "name": "nvme0n1", 00:23:14.857 "aliases": [ 00:23:14.857 "3969eaff-2e58-4a9a-a08d-826d6957fc74" 00:23:14.857 ], 00:23:14.857 "product_name": "NVMe disk", 00:23:14.857 "block_size": 512, 00:23:14.857 "num_blocks": 2097152, 00:23:14.857 "uuid": "3969eaff-2e58-4a9a-a08d-826d6957fc74", 00:23:14.857 "assigned_rate_limits": { 00:23:14.857 "rw_ios_per_sec": 0, 00:23:14.857 "rw_mbytes_per_sec": 0, 00:23:14.857 "r_mbytes_per_sec": 0, 00:23:14.857 "w_mbytes_per_sec": 0 00:23:14.857 }, 00:23:14.857 "claimed": false, 00:23:14.857 "zoned": false, 00:23:14.857 "supported_io_types": { 00:23:14.857 "read": true, 00:23:14.857 "write": true, 00:23:14.857 "unmap": false, 00:23:14.857 "write_zeroes": true, 00:23:14.857 "flush": true, 00:23:14.857 "reset": true, 00:23:14.857 "compare": true, 00:23:14.857 "compare_and_write": true, 00:23:14.857 "abort": true, 00:23:14.857 "nvme_admin": true, 00:23:14.857 "nvme_io": true 00:23:14.857 }, 00:23:14.857 "driver_specific": { 00:23:14.857 "nvme": [ 00:23:14.857 { 00:23:14.857 "trid": { 00:23:14.857 "trtype": "TCP", 00:23:14.857 "adrfam": "IPv4", 00:23:14.857 "traddr": "10.0.0.2", 00:23:14.857 "trsvcid": "4421", 00:23:14.857 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:14.857 }, 00:23:14.857 "ctrlr_data": { 00:23:14.857 "cntlid": 3, 00:23:14.857 "vendor_id": "0x8086", 00:23:14.857 "model_number": "SPDK bdev Controller", 00:23:14.857 "serial_number": "00000000000000000000", 00:23:14.857 "firmware_revision": "24.01.1", 00:23:14.857 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:14.857 "oacs": { 00:23:14.857 "security": 0, 00:23:14.857 "format": 0, 00:23:14.857 "firmware": 0, 00:23:14.857 "ns_manage": 0 00:23:14.857 }, 00:23:14.857 "multi_ctrlr": true, 00:23:14.857 "ana_reporting": false 00:23:14.857 }, 00:23:14.857 "vs": { 00:23:14.857 "nvme_version": "1.3" 00:23:14.857 }, 00:23:14.857 "ns_data": { 00:23:14.857 "id": 1, 00:23:14.857 "can_share": true 00:23:14.857 } 00:23:14.857 } 00:23:14.857 ], 00:23:14.857 "mp_policy": "active_passive" 00:23:14.857 } 00:23:14.857 } 00:23:14.857 ] 00:23:14.857 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.857 07:21:17 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:14.857 07:21:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:14.857 07:21:17 -- common/autotest_common.sh@10 -- # set +x 00:23:14.857 07:21:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:14.857 07:21:17 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.sdjGMstjJ4 00:23:14.857 07:21:17 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:14.857 07:21:17 -- host/async_init.sh@78 -- # nvmftestfini 00:23:14.857 07:21:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:14.857 07:21:17 -- nvmf/common.sh@116 -- # sync 00:23:14.857 07:21:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:14.857 07:21:17 -- nvmf/common.sh@119 -- # set +e 00:23:14.857 07:21:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:14.857 07:21:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:14.857 rmmod nvme_tcp 00:23:14.857 rmmod nvme_fabrics 00:23:14.857 rmmod nvme_keyring 00:23:14.857 07:21:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:14.857 07:21:17 -- nvmf/common.sh@123 -- # set -e 00:23:14.857 07:21:17 -- nvmf/common.sh@124 -- # return 0 00:23:14.857 07:21:17 -- nvmf/common.sh@477 -- # '[' -n 1977155 ']' 00:23:14.857 07:21:17 -- nvmf/common.sh@478 -- # killprocess 1977155 00:23:14.857 07:21:17 -- common/autotest_common.sh@926 -- # '[' -z 1977155 ']' 00:23:14.857 07:21:17 -- common/autotest_common.sh@930 -- # kill -0 1977155 00:23:14.857 07:21:17 -- common/autotest_common.sh@931 -- # uname 00:23:14.857 07:21:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:14.857 07:21:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1977155 00:23:14.857 07:21:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:14.857 07:21:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:14.857 07:21:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1977155' 00:23:14.857 killing process with pid 1977155 00:23:14.857 07:21:17 -- common/autotest_common.sh@945 -- # kill 1977155 00:23:14.857 07:21:17 -- common/autotest_common.sh@950 -- # wait 1977155 00:23:15.116 07:21:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:15.116 07:21:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:15.116 07:21:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:15.116 07:21:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:15.116 07:21:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:15.116 07:21:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.116 07:21:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.116 07:21:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.655 07:21:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:17.655 00:23:17.655 real 0m6.278s 00:23:17.655 user 0m2.961s 00:23:17.655 sys 0m1.918s 00:23:17.655 07:21:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:17.655 07:21:19 -- common/autotest_common.sh@10 -- # set +x 00:23:17.655 ************************************ 00:23:17.655 END TEST nvmf_async_init 00:23:17.655 ************************************ 00:23:17.655 07:21:19 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:17.655 07:21:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:17.655 07:21:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:17.655 07:21:19 -- common/autotest_common.sh@10 -- # set +x 00:23:17.655 ************************************ 00:23:17.655 START TEST dma 00:23:17.655 ************************************ 00:23:17.655 07:21:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:17.655 * Looking for test storage... 00:23:17.655 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.655 07:21:20 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.655 07:21:20 -- nvmf/common.sh@7 -- # uname -s 00:23:17.655 07:21:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.655 07:21:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.655 07:21:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.655 07:21:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.655 07:21:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.655 07:21:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.655 07:21:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.655 07:21:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.655 07:21:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.655 07:21:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.655 07:21:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.655 07:21:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.655 07:21:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.655 07:21:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.655 07:21:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.655 07:21:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.655 07:21:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.655 07:21:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.655 07:21:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.655 07:21:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.655 07:21:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.655 07:21:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.655 07:21:20 -- paths/export.sh@5 -- # export PATH 00:23:17.655 07:21:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.655 07:21:20 -- nvmf/common.sh@46 -- # : 0 00:23:17.655 07:21:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.655 07:21:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.655 07:21:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.655 07:21:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.655 07:21:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.655 07:21:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.655 07:21:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.655 07:21:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.655 07:21:20 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:17.655 07:21:20 -- host/dma.sh@13 -- # exit 0 00:23:17.655 00:23:17.655 real 0m0.068s 00:23:17.655 user 0m0.038s 00:23:17.655 sys 0m0.036s 00:23:17.655 07:21:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:17.655 07:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:17.655 ************************************ 00:23:17.655 END TEST dma 00:23:17.655 ************************************ 00:23:17.655 07:21:20 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:17.655 07:21:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:17.655 07:21:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:17.655 07:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:17.655 ************************************ 00:23:17.655 START TEST nvmf_identify 00:23:17.655 ************************************ 00:23:17.655 07:21:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:17.655 * Looking for test storage... 00:23:17.655 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.655 07:21:20 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.655 07:21:20 -- nvmf/common.sh@7 -- # uname -s 00:23:17.655 07:21:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.656 07:21:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.656 07:21:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.656 07:21:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.656 07:21:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.656 07:21:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.656 07:21:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.656 07:21:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.656 07:21:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.656 07:21:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.656 07:21:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.656 07:21:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.656 07:21:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.656 07:21:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.656 07:21:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.656 07:21:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.656 07:21:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.656 07:21:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.656 07:21:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.656 07:21:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.656 07:21:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.656 07:21:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.656 07:21:20 -- paths/export.sh@5 -- # export PATH 00:23:17.656 07:21:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.656 07:21:20 -- nvmf/common.sh@46 -- # : 0 00:23:17.656 07:21:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.656 07:21:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.656 07:21:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.656 07:21:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.656 07:21:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.656 07:21:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.656 07:21:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.656 07:21:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.656 07:21:20 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:17.656 07:21:20 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:17.656 07:21:20 -- host/identify.sh@14 -- # nvmftestinit 00:23:17.656 07:21:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:17.656 07:21:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:17.656 07:21:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:17.656 07:21:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:17.656 07:21:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:17.656 07:21:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.656 07:21:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.656 07:21:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.656 07:21:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:17.656 07:21:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:17.656 07:21:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:17.656 07:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:19.556 07:21:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:19.556 07:21:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:19.556 07:21:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:19.556 07:21:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:19.556 07:21:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:19.556 07:21:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:19.557 07:21:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:19.557 07:21:22 -- nvmf/common.sh@294 -- # net_devs=() 00:23:19.557 07:21:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:19.557 07:21:22 -- nvmf/common.sh@295 -- # e810=() 00:23:19.557 07:21:22 -- nvmf/common.sh@295 -- # local -ga e810 00:23:19.557 07:21:22 -- nvmf/common.sh@296 -- # x722=() 00:23:19.557 07:21:22 -- nvmf/common.sh@296 -- # local -ga x722 00:23:19.557 07:21:22 -- nvmf/common.sh@297 -- # mlx=() 00:23:19.557 07:21:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:19.557 07:21:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:19.557 07:21:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.557 07:21:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:19.557 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:19.557 07:21:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.557 07:21:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:19.557 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:19.557 07:21:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.557 07:21:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.557 07:21:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.557 07:21:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:19.557 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:19.557 07:21:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.557 07:21:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.557 07:21:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.557 07:21:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:19.557 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:19.557 07:21:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:19.557 07:21:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:19.557 07:21:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:19.557 07:21:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:19.557 07:21:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:19.557 07:21:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:19.557 07:21:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:19.557 07:21:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:19.557 07:21:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:19.557 07:21:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:19.557 07:21:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:19.557 07:21:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:19.557 07:21:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:19.557 07:21:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:19.557 07:21:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:19.557 07:21:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:19.557 07:21:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:19.557 07:21:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:19.557 07:21:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:19.557 07:21:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:19.557 07:21:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:19.557 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:19.557 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:23:19.557 00:23:19.557 --- 10.0.0.2 ping statistics --- 00:23:19.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.557 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:23:19.557 07:21:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:19.557 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:19.557 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:23:19.557 00:23:19.557 --- 10.0.0.1 ping statistics --- 00:23:19.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.557 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:23:19.557 07:21:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:19.557 07:21:22 -- nvmf/common.sh@410 -- # return 0 00:23:19.557 07:21:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:19.557 07:21:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:19.557 07:21:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:19.557 07:21:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:19.557 07:21:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:19.557 07:21:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:19.557 07:21:22 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:19.557 07:21:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:19.557 07:21:22 -- common/autotest_common.sh@10 -- # set +x 00:23:19.557 07:21:22 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:19.557 07:21:22 -- host/identify.sh@19 -- # nvmfpid=1979415 00:23:19.557 07:21:22 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:19.557 07:21:22 -- host/identify.sh@23 -- # waitforlisten 1979415 00:23:19.557 07:21:22 -- common/autotest_common.sh@819 -- # '[' -z 1979415 ']' 00:23:19.557 07:21:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.557 07:21:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:19.557 07:21:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.557 07:21:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:19.557 07:21:22 -- common/autotest_common.sh@10 -- # set +x 00:23:19.557 [2024-10-16 07:21:22.378089] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:19.557 [2024-10-16 07:21:22.378183] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.557 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.557 [2024-10-16 07:21:22.447578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:19.816 [2024-10-16 07:21:22.564114] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:19.816 [2024-10-16 07:21:22.564284] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.816 [2024-10-16 07:21:22.564303] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.816 [2024-10-16 07:21:22.564317] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.816 [2024-10-16 07:21:22.564411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:19.816 [2024-10-16 07:21:22.564479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:19.816 [2024-10-16 07:21:22.564534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:19.816 [2024-10-16 07:21:22.564536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:20.751 07:21:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:20.751 07:21:23 -- common/autotest_common.sh@852 -- # return 0 00:23:20.751 07:21:23 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 [2024-10-16 07:21:23.347285] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:20.751 07:21:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 07:21:23 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 Malloc0 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 [2024-10-16 07:21:23.428630] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:20.751 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:20.751 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:20.751 [2024-10-16 07:21:23.444391] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:20.751 [ 00:23:20.751 { 00:23:20.751 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:20.751 "subtype": "Discovery", 00:23:20.751 "listen_addresses": [ 00:23:20.751 { 00:23:20.751 "transport": "TCP", 00:23:20.751 "trtype": "TCP", 00:23:20.751 "adrfam": "IPv4", 00:23:20.751 "traddr": "10.0.0.2", 00:23:20.751 "trsvcid": "4420" 00:23:20.751 } 00:23:20.751 ], 00:23:20.751 "allow_any_host": true, 00:23:20.751 "hosts": [] 00:23:20.751 }, 00:23:20.751 { 00:23:20.751 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:20.751 "subtype": "NVMe", 00:23:20.751 "listen_addresses": [ 00:23:20.751 { 00:23:20.751 "transport": "TCP", 00:23:20.751 "trtype": "TCP", 00:23:20.751 "adrfam": "IPv4", 00:23:20.751 "traddr": "10.0.0.2", 00:23:20.751 "trsvcid": "4420" 00:23:20.751 } 00:23:20.751 ], 00:23:20.751 "allow_any_host": true, 00:23:20.751 "hosts": [], 00:23:20.751 "serial_number": "SPDK00000000000001", 00:23:20.751 "model_number": "SPDK bdev Controller", 00:23:20.751 "max_namespaces": 32, 00:23:20.751 "min_cntlid": 1, 00:23:20.751 "max_cntlid": 65519, 00:23:20.751 "namespaces": [ 00:23:20.751 { 00:23:20.751 "nsid": 1, 00:23:20.751 "bdev_name": "Malloc0", 00:23:20.751 "name": "Malloc0", 00:23:20.751 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:20.751 "eui64": "ABCDEF0123456789", 00:23:20.751 "uuid": "b78ff91f-f937-45ca-aa95-dbf04f1c1395" 00:23:20.751 } 00:23:20.751 ] 00:23:20.751 } 00:23:20.751 ] 00:23:20.751 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:20.751 07:21:23 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:20.751 [2024-10-16 07:21:23.469817] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:20.751 [2024-10-16 07:21:23.469858] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1979577 ] 00:23:20.751 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.751 [2024-10-16 07:21:23.501011] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:20.751 [2024-10-16 07:21:23.501096] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:20.751 [2024-10-16 07:21:23.501107] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:20.751 [2024-10-16 07:21:23.501122] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:20.751 [2024-10-16 07:21:23.501135] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:20.751 [2024-10-16 07:21:23.504798] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:20.751 [2024-10-16 07:21:23.504869] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x23dbe10 0 00:23:20.751 [2024-10-16 07:21:23.511744] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:20.751 [2024-10-16 07:21:23.511767] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:20.751 [2024-10-16 07:21:23.511777] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:20.751 [2024-10-16 07:21:23.511783] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:20.751 [2024-10-16 07:21:23.511839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.751 [2024-10-16 07:21:23.511853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.751 [2024-10-16 07:21:23.511861] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.751 [2024-10-16 07:21:23.511883] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:20.751 [2024-10-16 07:21:23.511910] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.751 [2024-10-16 07:21:23.518755] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.751 [2024-10-16 07:21:23.518773] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.751 [2024-10-16 07:21:23.518781] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.751 [2024-10-16 07:21:23.518789] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.751 [2024-10-16 07:21:23.518811] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:20.751 [2024-10-16 07:21:23.518823] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:20.751 [2024-10-16 07:21:23.518833] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:20.751 [2024-10-16 07:21:23.518854] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.751 [2024-10-16 07:21:23.518863] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.518869] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.518880] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.518905] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.519001] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.519013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.519020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.519037] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:20.752 [2024-10-16 07:21:23.519049] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:20.752 [2024-10-16 07:21:23.519061] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519069] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519075] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.519085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.519106] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.519184] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.519196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.519202] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519214] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.519224] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:20.752 [2024-10-16 07:21:23.519238] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519250] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519257] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519263] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.519273] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.519294] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.519381] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.519395] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.519402] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519408] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.519418] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519435] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519443] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519449] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.519460] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.519480] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.519563] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.519577] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.519584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.519601] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:20.752 [2024-10-16 07:21:23.519609] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519622] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519733] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:20.752 [2024-10-16 07:21:23.519743] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519760] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519768] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519774] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.519785] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.519806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.519889] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.519901] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.519908] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.519924] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:20.752 [2024-10-16 07:21:23.519939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519948] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.519954] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.519965] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.519985] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.520064] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.520078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.520085] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.520092] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.520102] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:20.752 [2024-10-16 07:21:23.520110] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:20.752 [2024-10-16 07:21:23.520122] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:20.752 [2024-10-16 07:21:23.520142] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:20.752 [2024-10-16 07:21:23.520159] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.520167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.520173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.520184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.752 [2024-10-16 07:21:23.520206] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.520334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:20.752 [2024-10-16 07:21:23.520349] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:20.752 [2024-10-16 07:21:23.520355] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.520363] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x23dbe10): datao=0, datal=4096, cccid=0 00:23:20.752 [2024-10-16 07:21:23.520371] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x245bb30) on tqpair(0x23dbe10): expected_datao=0, payload_size=4096 00:23:20.752 [2024-10-16 07:21:23.520391] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.520402] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.564738] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.564757] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.564764] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.564786] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.564806] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:20.752 [2024-10-16 07:21:23.564816] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:20.752 [2024-10-16 07:21:23.564823] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:20.752 [2024-10-16 07:21:23.564832] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:20.752 [2024-10-16 07:21:23.564839] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:20.752 [2024-10-16 07:21:23.564847] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:20.752 [2024-10-16 07:21:23.564868] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:20.752 [2024-10-16 07:21:23.564882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.564890] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.564896] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.564908] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:20.752 [2024-10-16 07:21:23.564933] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.752 [2024-10-16 07:21:23.565026] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.752 [2024-10-16 07:21:23.565041] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.752 [2024-10-16 07:21:23.565048] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.565054] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bb30) on tqpair=0x23dbe10 00:23:20.752 [2024-10-16 07:21:23.565069] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.565076] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.752 [2024-10-16 07:21:23.565083] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x23dbe10) 00:23:20.752 [2024-10-16 07:21:23.565092] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:20.752 [2024-10-16 07:21:23.565103] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565109] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565116] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:20.753 [2024-10-16 07:21:23.565134] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565141] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:20.753 [2024-10-16 07:21:23.565165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565172] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565178] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565186] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:20.753 [2024-10-16 07:21:23.565199] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:20.753 [2024-10-16 07:21:23.565219] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:20.753 [2024-10-16 07:21:23.565232] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565239] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565246] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565257] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.753 [2024-10-16 07:21:23.565280] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bb30, cid 0, qid 0 00:23:20.753 [2024-10-16 07:21:23.565291] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bc90, cid 1, qid 0 00:23:20.753 [2024-10-16 07:21:23.565299] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bdf0, cid 2, qid 0 00:23:20.753 [2024-10-16 07:21:23.565306] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.753 [2024-10-16 07:21:23.565313] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c0b0, cid 4, qid 0 00:23:20.753 [2024-10-16 07:21:23.565432] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.565444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.565450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c0b0) on tqpair=0x23dbe10 00:23:20.753 [2024-10-16 07:21:23.565468] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:20.753 [2024-10-16 07:21:23.565476] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:20.753 [2024-10-16 07:21:23.565493] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565502] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565509] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.753 [2024-10-16 07:21:23.565540] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c0b0, cid 4, qid 0 00:23:20.753 [2024-10-16 07:21:23.565638] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:20.753 [2024-10-16 07:21:23.565649] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:20.753 [2024-10-16 07:21:23.565656] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565662] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x23dbe10): datao=0, datal=4096, cccid=4 00:23:20.753 [2024-10-16 07:21:23.565670] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x245c0b0) on tqpair(0x23dbe10): expected_datao=0, payload_size=4096 00:23:20.753 [2024-10-16 07:21:23.565680] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565688] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.565709] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.565716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565722] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c0b0) on tqpair=0x23dbe10 00:23:20.753 [2024-10-16 07:21:23.565751] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:20.753 [2024-10-16 07:21:23.565804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.753 [2024-10-16 07:21:23.565845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.565858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.565867] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:20.753 [2024-10-16 07:21:23.565894] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c0b0, cid 4, qid 0 00:23:20.753 [2024-10-16 07:21:23.565906] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c210, cid 5, qid 0 00:23:20.753 [2024-10-16 07:21:23.566038] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:20.753 [2024-10-16 07:21:23.566053] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:20.753 [2024-10-16 07:21:23.566060] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.566066] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x23dbe10): datao=0, datal=1024, cccid=4 00:23:20.753 [2024-10-16 07:21:23.566074] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x245c0b0) on tqpair(0x23dbe10): expected_datao=0, payload_size=1024 00:23:20.753 [2024-10-16 07:21:23.566084] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.566092] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.566100] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.566109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.566115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.566121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c210) on tqpair=0x23dbe10 00:23:20.753 [2024-10-16 07:21:23.606853] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.606873] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.606881] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.606888] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c0b0) on tqpair=0x23dbe10 00:23:20.753 [2024-10-16 07:21:23.606909] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.606918] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.606924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.606935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.753 [2024-10-16 07:21:23.606965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c0b0, cid 4, qid 0 00:23:20.753 [2024-10-16 07:21:23.607156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:20.753 [2024-10-16 07:21:23.607169] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:20.753 [2024-10-16 07:21:23.607176] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607182] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x23dbe10): datao=0, datal=3072, cccid=4 00:23:20.753 [2024-10-16 07:21:23.607189] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x245c0b0) on tqpair(0x23dbe10): expected_datao=0, payload_size=3072 00:23:20.753 [2024-10-16 07:21:23.607200] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607213] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607226] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.607236] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.607242] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607249] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c0b0) on tqpair=0x23dbe10 00:23:20.753 [2024-10-16 07:21:23.607266] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607280] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x23dbe10) 00:23:20.753 [2024-10-16 07:21:23.607291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.753 [2024-10-16 07:21:23.607319] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245c0b0, cid 4, qid 0 00:23:20.753 [2024-10-16 07:21:23.607417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:20.753 [2024-10-16 07:21:23.607429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:20.753 [2024-10-16 07:21:23.607435] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607441] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x23dbe10): datao=0, datal=8, cccid=4 00:23:20.753 [2024-10-16 07:21:23.607448] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x245c0b0) on tqpair(0x23dbe10): expected_datao=0, payload_size=8 00:23:20.753 [2024-10-16 07:21:23.607459] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.607466] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.647806] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.753 [2024-10-16 07:21:23.647825] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.753 [2024-10-16 07:21:23.647832] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.753 [2024-10-16 07:21:23.647839] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245c0b0) on tqpair=0x23dbe10 00:23:20.753 ===================================================== 00:23:20.753 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:20.753 ===================================================== 00:23:20.753 Controller Capabilities/Features 00:23:20.753 ================================ 00:23:20.753 Vendor ID: 0000 00:23:20.753 Subsystem Vendor ID: 0000 00:23:20.753 Serial Number: .................... 00:23:20.754 Model Number: ........................................ 00:23:20.754 Firmware Version: 24.01.1 00:23:20.754 Recommended Arb Burst: 0 00:23:20.754 IEEE OUI Identifier: 00 00 00 00:23:20.754 Multi-path I/O 00:23:20.754 May have multiple subsystem ports: No 00:23:20.754 May have multiple controllers: No 00:23:20.754 Associated with SR-IOV VF: No 00:23:20.754 Max Data Transfer Size: 131072 00:23:20.754 Max Number of Namespaces: 0 00:23:20.754 Max Number of I/O Queues: 1024 00:23:20.754 NVMe Specification Version (VS): 1.3 00:23:20.754 NVMe Specification Version (Identify): 1.3 00:23:20.754 Maximum Queue Entries: 128 00:23:20.754 Contiguous Queues Required: Yes 00:23:20.754 Arbitration Mechanisms Supported 00:23:20.754 Weighted Round Robin: Not Supported 00:23:20.754 Vendor Specific: Not Supported 00:23:20.754 Reset Timeout: 15000 ms 00:23:20.754 Doorbell Stride: 4 bytes 00:23:20.754 NVM Subsystem Reset: Not Supported 00:23:20.754 Command Sets Supported 00:23:20.754 NVM Command Set: Supported 00:23:20.754 Boot Partition: Not Supported 00:23:20.754 Memory Page Size Minimum: 4096 bytes 00:23:20.754 Memory Page Size Maximum: 4096 bytes 00:23:20.754 Persistent Memory Region: Not Supported 00:23:20.754 Optional Asynchronous Events Supported 00:23:20.754 Namespace Attribute Notices: Not Supported 00:23:20.754 Firmware Activation Notices: Not Supported 00:23:20.754 ANA Change Notices: Not Supported 00:23:20.754 PLE Aggregate Log Change Notices: Not Supported 00:23:20.754 LBA Status Info Alert Notices: Not Supported 00:23:20.754 EGE Aggregate Log Change Notices: Not Supported 00:23:20.754 Normal NVM Subsystem Shutdown event: Not Supported 00:23:20.754 Zone Descriptor Change Notices: Not Supported 00:23:20.754 Discovery Log Change Notices: Supported 00:23:20.754 Controller Attributes 00:23:20.754 128-bit Host Identifier: Not Supported 00:23:20.754 Non-Operational Permissive Mode: Not Supported 00:23:20.754 NVM Sets: Not Supported 00:23:20.754 Read Recovery Levels: Not Supported 00:23:20.754 Endurance Groups: Not Supported 00:23:20.754 Predictable Latency Mode: Not Supported 00:23:20.754 Traffic Based Keep ALive: Not Supported 00:23:20.754 Namespace Granularity: Not Supported 00:23:20.754 SQ Associations: Not Supported 00:23:20.754 UUID List: Not Supported 00:23:20.754 Multi-Domain Subsystem: Not Supported 00:23:20.754 Fixed Capacity Management: Not Supported 00:23:20.754 Variable Capacity Management: Not Supported 00:23:20.754 Delete Endurance Group: Not Supported 00:23:20.754 Delete NVM Set: Not Supported 00:23:20.754 Extended LBA Formats Supported: Not Supported 00:23:20.754 Flexible Data Placement Supported: Not Supported 00:23:20.754 00:23:20.754 Controller Memory Buffer Support 00:23:20.754 ================================ 00:23:20.754 Supported: No 00:23:20.754 00:23:20.754 Persistent Memory Region Support 00:23:20.754 ================================ 00:23:20.754 Supported: No 00:23:20.754 00:23:20.754 Admin Command Set Attributes 00:23:20.754 ============================ 00:23:20.754 Security Send/Receive: Not Supported 00:23:20.754 Format NVM: Not Supported 00:23:20.754 Firmware Activate/Download: Not Supported 00:23:20.754 Namespace Management: Not Supported 00:23:20.754 Device Self-Test: Not Supported 00:23:20.754 Directives: Not Supported 00:23:20.754 NVMe-MI: Not Supported 00:23:20.754 Virtualization Management: Not Supported 00:23:20.754 Doorbell Buffer Config: Not Supported 00:23:20.754 Get LBA Status Capability: Not Supported 00:23:20.754 Command & Feature Lockdown Capability: Not Supported 00:23:20.754 Abort Command Limit: 1 00:23:20.754 Async Event Request Limit: 4 00:23:20.754 Number of Firmware Slots: N/A 00:23:20.754 Firmware Slot 1 Read-Only: N/A 00:23:20.754 Firmware Activation Without Reset: N/A 00:23:20.754 Multiple Update Detection Support: N/A 00:23:20.754 Firmware Update Granularity: No Information Provided 00:23:20.754 Per-Namespace SMART Log: No 00:23:20.754 Asymmetric Namespace Access Log Page: Not Supported 00:23:20.754 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:20.754 Command Effects Log Page: Not Supported 00:23:20.754 Get Log Page Extended Data: Supported 00:23:20.754 Telemetry Log Pages: Not Supported 00:23:20.754 Persistent Event Log Pages: Not Supported 00:23:20.754 Supported Log Pages Log Page: May Support 00:23:20.754 Commands Supported & Effects Log Page: Not Supported 00:23:20.754 Feature Identifiers & Effects Log Page:May Support 00:23:20.754 NVMe-MI Commands & Effects Log Page: May Support 00:23:20.754 Data Area 4 for Telemetry Log: Not Supported 00:23:20.754 Error Log Page Entries Supported: 128 00:23:20.754 Keep Alive: Not Supported 00:23:20.754 00:23:20.754 NVM Command Set Attributes 00:23:20.754 ========================== 00:23:20.754 Submission Queue Entry Size 00:23:20.754 Max: 1 00:23:20.754 Min: 1 00:23:20.754 Completion Queue Entry Size 00:23:20.754 Max: 1 00:23:20.754 Min: 1 00:23:20.754 Number of Namespaces: 0 00:23:20.754 Compare Command: Not Supported 00:23:20.754 Write Uncorrectable Command: Not Supported 00:23:20.754 Dataset Management Command: Not Supported 00:23:20.754 Write Zeroes Command: Not Supported 00:23:20.754 Set Features Save Field: Not Supported 00:23:20.754 Reservations: Not Supported 00:23:20.754 Timestamp: Not Supported 00:23:20.754 Copy: Not Supported 00:23:20.754 Volatile Write Cache: Not Present 00:23:20.754 Atomic Write Unit (Normal): 1 00:23:20.754 Atomic Write Unit (PFail): 1 00:23:20.754 Atomic Compare & Write Unit: 1 00:23:20.754 Fused Compare & Write: Supported 00:23:20.754 Scatter-Gather List 00:23:20.754 SGL Command Set: Supported 00:23:20.754 SGL Keyed: Supported 00:23:20.754 SGL Bit Bucket Descriptor: Not Supported 00:23:20.754 SGL Metadata Pointer: Not Supported 00:23:20.754 Oversized SGL: Not Supported 00:23:20.754 SGL Metadata Address: Not Supported 00:23:20.754 SGL Offset: Supported 00:23:20.754 Transport SGL Data Block: Not Supported 00:23:20.754 Replay Protected Memory Block: Not Supported 00:23:20.754 00:23:20.754 Firmware Slot Information 00:23:20.754 ========================= 00:23:20.754 Active slot: 0 00:23:20.754 00:23:20.754 00:23:20.754 Error Log 00:23:20.754 ========= 00:23:20.754 00:23:20.754 Active Namespaces 00:23:20.754 ================= 00:23:20.754 Discovery Log Page 00:23:20.754 ================== 00:23:20.754 Generation Counter: 2 00:23:20.754 Number of Records: 2 00:23:20.754 Record Format: 0 00:23:20.754 00:23:20.754 Discovery Log Entry 0 00:23:20.754 ---------------------- 00:23:20.754 Transport Type: 3 (TCP) 00:23:20.754 Address Family: 1 (IPv4) 00:23:20.754 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:20.754 Entry Flags: 00:23:20.754 Duplicate Returned Information: 1 00:23:20.754 Explicit Persistent Connection Support for Discovery: 1 00:23:20.754 Transport Requirements: 00:23:20.754 Secure Channel: Not Required 00:23:20.754 Port ID: 0 (0x0000) 00:23:20.754 Controller ID: 65535 (0xffff) 00:23:20.754 Admin Max SQ Size: 128 00:23:20.754 Transport Service Identifier: 4420 00:23:20.754 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:20.754 Transport Address: 10.0.0.2 00:23:20.754 Discovery Log Entry 1 00:23:20.754 ---------------------- 00:23:20.754 Transport Type: 3 (TCP) 00:23:20.754 Address Family: 1 (IPv4) 00:23:20.754 Subsystem Type: 2 (NVM Subsystem) 00:23:20.754 Entry Flags: 00:23:20.754 Duplicate Returned Information: 0 00:23:20.754 Explicit Persistent Connection Support for Discovery: 0 00:23:20.754 Transport Requirements: 00:23:20.754 Secure Channel: Not Required 00:23:20.754 Port ID: 0 (0x0000) 00:23:20.754 Controller ID: 65535 (0xffff) 00:23:20.754 Admin Max SQ Size: 128 00:23:20.754 Transport Service Identifier: 4420 00:23:20.754 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:20.754 Transport Address: 10.0.0.2 [2024-10-16 07:21:23.647954] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:20.754 [2024-10-16 07:21:23.647982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:20.754 [2024-10-16 07:21:23.647995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:20.754 [2024-10-16 07:21:23.648004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:20.754 [2024-10-16 07:21:23.648013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:20.754 [2024-10-16 07:21:23.648027] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.754 [2024-10-16 07:21:23.648034] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.754 [2024-10-16 07:21:23.648040] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.754 [2024-10-16 07:21:23.648051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.754 [2024-10-16 07:21:23.648077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.754 [2024-10-16 07:21:23.648156] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.754 [2024-10-16 07:21:23.648168] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.754 [2024-10-16 07:21:23.648175] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648181] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bf50) on tqpair=0x23dbe10 00:23:20.755 [2024-10-16 07:21:23.648198] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648206] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648213] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.755 [2024-10-16 07:21:23.648223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.755 [2024-10-16 07:21:23.648249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.755 [2024-10-16 07:21:23.648369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.755 [2024-10-16 07:21:23.648381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.755 [2024-10-16 07:21:23.648388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648394] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bf50) on tqpair=0x23dbe10 00:23:20.755 [2024-10-16 07:21:23.648404] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:20.755 [2024-10-16 07:21:23.648412] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:20.755 [2024-10-16 07:21:23.648427] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648435] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648442] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.755 [2024-10-16 07:21:23.648452] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.755 [2024-10-16 07:21:23.648473] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.755 [2024-10-16 07:21:23.648554] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.755 [2024-10-16 07:21:23.648565] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.755 [2024-10-16 07:21:23.648572] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bf50) on tqpair=0x23dbe10 00:23:20.755 [2024-10-16 07:21:23.648596] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648605] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.648611] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.755 [2024-10-16 07:21:23.648621] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.755 [2024-10-16 07:21:23.648641] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.755 [2024-10-16 07:21:23.648718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.755 [2024-10-16 07:21:23.652740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.755 [2024-10-16 07:21:23.652752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.652759] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bf50) on tqpair=0x23dbe10 00:23:20.755 [2024-10-16 07:21:23.652793] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.652803] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.652809] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x23dbe10) 00:23:20.755 [2024-10-16 07:21:23.652820] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:20.755 [2024-10-16 07:21:23.652843] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x245bf50, cid 3, qid 0 00:23:20.755 [2024-10-16 07:21:23.652930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:20.755 [2024-10-16 07:21:23.652942] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:20.755 [2024-10-16 07:21:23.652954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:20.755 [2024-10-16 07:21:23.652961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x245bf50) on tqpair=0x23dbe10 00:23:20.755 [2024-10-16 07:21:23.652976] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:23:20.755 00:23:20.755 07:21:23 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:20.755 [2024-10-16 07:21:23.686227] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:20.755 [2024-10-16 07:21:23.686270] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1979580 ] 00:23:21.016 EAL: No free 2048 kB hugepages reported on node 1 00:23:21.016 [2024-10-16 07:21:23.718527] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:21.016 [2024-10-16 07:21:23.718580] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:21.016 [2024-10-16 07:21:23.718590] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:21.016 [2024-10-16 07:21:23.718604] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:21.016 [2024-10-16 07:21:23.718617] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:21.016 [2024-10-16 07:21:23.721762] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:21.016 [2024-10-16 07:21:23.721820] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xa1be10 0 00:23:21.016 [2024-10-16 07:21:23.729745] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:21.016 [2024-10-16 07:21:23.729764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:21.016 [2024-10-16 07:21:23.729772] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:21.016 [2024-10-16 07:21:23.729778] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:21.016 [2024-10-16 07:21:23.729817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.729828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.729835] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.016 [2024-10-16 07:21:23.729849] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:21.016 [2024-10-16 07:21:23.729875] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.016 [2024-10-16 07:21:23.737742] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.016 [2024-10-16 07:21:23.737760] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.016 [2024-10-16 07:21:23.737768] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.737775] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.016 [2024-10-16 07:21:23.737789] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:21.016 [2024-10-16 07:21:23.737800] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:21.016 [2024-10-16 07:21:23.737809] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:21.016 [2024-10-16 07:21:23.737826] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.737838] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.737846] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.016 [2024-10-16 07:21:23.737857] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.016 [2024-10-16 07:21:23.737881] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.016 [2024-10-16 07:21:23.738006] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.016 [2024-10-16 07:21:23.738018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.016 [2024-10-16 07:21:23.738025] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.016 [2024-10-16 07:21:23.738032] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.738040] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:21.017 [2024-10-16 07:21:23.738053] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:21.017 [2024-10-16 07:21:23.738065] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738073] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738079] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.738089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.738110] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.738197] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.738211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.738218] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738225] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.738234] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:21.017 [2024-10-16 07:21:23.738248] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738260] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738267] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738273] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.738284] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.738305] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.738389] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.738404] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.738411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738417] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.738426] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738442] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738451] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738458] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.738468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.738494] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.738574] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.738586] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.738593] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738599] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.738607] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:21.017 [2024-10-16 07:21:23.738615] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738628] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738738] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:21.017 [2024-10-16 07:21:23.738747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738772] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.738783] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.738804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.738893] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.738905] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.738912] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738918] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.738926] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:21.017 [2024-10-16 07:21:23.738942] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738951] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.738957] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.738968] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.738988] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.739067] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.739081] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.739088] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.739095] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.739102] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:21.017 [2024-10-16 07:21:23.739110] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:21.017 [2024-10-16 07:21:23.739123] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:21.017 [2024-10-16 07:21:23.739144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:21.017 [2024-10-16 07:21:23.739159] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.739167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.739173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.739184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.017 [2024-10-16 07:21:23.739206] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.739325] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.017 [2024-10-16 07:21:23.739337] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.017 [2024-10-16 07:21:23.739344] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.739351] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=4096, cccid=0 00:23:21.017 [2024-10-16 07:21:23.739358] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9bb30) on tqpair(0xa1be10): expected_datao=0, payload_size=4096 00:23:21.017 [2024-10-16 07:21:23.739375] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.739384] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.779844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.779864] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.779873] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.779880] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.779892] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:21.017 [2024-10-16 07:21:23.779901] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:21.017 [2024-10-16 07:21:23.779909] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:21.017 [2024-10-16 07:21:23.779917] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:21.017 [2024-10-16 07:21:23.779926] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:21.017 [2024-10-16 07:21:23.779935] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:21.017 [2024-10-16 07:21:23.779955] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:21.017 [2024-10-16 07:21:23.779970] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.779977] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.779984] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.779995] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:21.017 [2024-10-16 07:21:23.780021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.017 [2024-10-16 07:21:23.780104] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.017 [2024-10-16 07:21:23.780116] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.017 [2024-10-16 07:21:23.780124] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780131] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bb30) on tqpair=0xa1be10 00:23:21.017 [2024-10-16 07:21:23.780141] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780160] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.780171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.017 [2024-10-16 07:21:23.780183] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780190] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.780206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.017 [2024-10-16 07:21:23.780217] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780223] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.017 [2024-10-16 07:21:23.780230] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xa1be10) 00:23:21.017 [2024-10-16 07:21:23.780238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.018 [2024-10-16 07:21:23.780248] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780255] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.780270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.018 [2024-10-16 07:21:23.780280] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780298] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780311] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780318] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780325] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.780335] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.018 [2024-10-16 07:21:23.780358] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bb30, cid 0, qid 0 00:23:21.018 [2024-10-16 07:21:23.780369] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bc90, cid 1, qid 0 00:23:21.018 [2024-10-16 07:21:23.780377] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bdf0, cid 2, qid 0 00:23:21.018 [2024-10-16 07:21:23.780384] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.018 [2024-10-16 07:21:23.780391] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.018 [2024-10-16 07:21:23.780531] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.018 [2024-10-16 07:21:23.780543] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.018 [2024-10-16 07:21:23.780550] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780557] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.018 [2024-10-16 07:21:23.780565] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:21.018 [2024-10-16 07:21:23.780573] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780587] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780606] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780626] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780632] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.780643] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:21.018 [2024-10-16 07:21:23.780663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.018 [2024-10-16 07:21:23.780751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.018 [2024-10-16 07:21:23.780765] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.018 [2024-10-16 07:21:23.780772] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.018 [2024-10-16 07:21:23.780843] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780862] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.780876] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780884] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.780891] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.780901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.018 [2024-10-16 07:21:23.780922] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.018 [2024-10-16 07:21:23.781032] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.018 [2024-10-16 07:21:23.781047] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.018 [2024-10-16 07:21:23.781054] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781060] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=4096, cccid=4 00:23:21.018 [2024-10-16 07:21:23.781068] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c0b0) on tqpair(0xa1be10): expected_datao=0, payload_size=4096 00:23:21.018 [2024-10-16 07:21:23.781079] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781087] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781098] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.018 [2024-10-16 07:21:23.781108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.018 [2024-10-16 07:21:23.781115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781122] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.018 [2024-10-16 07:21:23.781144] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:21.018 [2024-10-16 07:21:23.781161] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.781180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.781194] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781202] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.781223] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.018 [2024-10-16 07:21:23.781245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.018 [2024-10-16 07:21:23.781354] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.018 [2024-10-16 07:21:23.781369] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.018 [2024-10-16 07:21:23.781376] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781383] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=4096, cccid=4 00:23:21.018 [2024-10-16 07:21:23.781390] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c0b0) on tqpair(0xa1be10): expected_datao=0, payload_size=4096 00:23:21.018 [2024-10-16 07:21:23.781401] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781409] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781421] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.018 [2024-10-16 07:21:23.781431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.018 [2024-10-16 07:21:23.781438] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781444] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.018 [2024-10-16 07:21:23.781468] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.781488] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.781502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781510] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781516] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.781527] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.018 [2024-10-16 07:21:23.781548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.018 [2024-10-16 07:21:23.781648] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.018 [2024-10-16 07:21:23.781664] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.018 [2024-10-16 07:21:23.781671] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781677] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=4096, cccid=4 00:23:21.018 [2024-10-16 07:21:23.781685] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c0b0) on tqpair(0xa1be10): expected_datao=0, payload_size=4096 00:23:21.018 [2024-10-16 07:21:23.781696] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781703] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.781715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.018 [2024-10-16 07:21:23.781725] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.018 [2024-10-16 07:21:23.785747] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.785755] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.018 [2024-10-16 07:21:23.785771] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785830] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785845] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785854] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785863] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:21.018 [2024-10-16 07:21:23.785871] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:21.018 [2024-10-16 07:21:23.785883] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:21.018 [2024-10-16 07:21:23.785902] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.785910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.785917] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.785927] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.018 [2024-10-16 07:21:23.785939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.785946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.018 [2024-10-16 07:21:23.785952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xa1be10) 00:23:21.018 [2024-10-16 07:21:23.785962] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:21.018 [2024-10-16 07:21:23.785988] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.019 [2024-10-16 07:21:23.786000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c210, cid 5, qid 0 00:23:21.019 [2024-10-16 07:21:23.786127] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.786142] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.786150] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786156] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.786166] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.786176] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.786182] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786189] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c210) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.786204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786213] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786219] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786229] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786251] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c210, cid 5, qid 0 00:23:21.019 [2024-10-16 07:21:23.786355] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.786367] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.786374] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786380] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c210) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.786395] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786404] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786414] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786425] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786446] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c210, cid 5, qid 0 00:23:21.019 [2024-10-16 07:21:23.786527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.786542] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.786548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c210) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.786571] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786580] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786586] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786597] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786618] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c210, cid 5, qid 0 00:23:21.019 [2024-10-16 07:21:23.786699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.786714] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.786720] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786734] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c210) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.786755] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786765] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786771] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786782] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786795] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786803] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786809] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786818] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786830] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786837] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786843] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786865] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786872] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.786878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xa1be10) 00:23:21.019 [2024-10-16 07:21:23.786888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.019 [2024-10-16 07:21:23.786910] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c210, cid 5, qid 0 00:23:21.019 [2024-10-16 07:21:23.786922] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c0b0, cid 4, qid 0 00:23:21.019 [2024-10-16 07:21:23.786933] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c370, cid 6, qid 0 00:23:21.019 [2024-10-16 07:21:23.786941] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c4d0, cid 7, qid 0 00:23:21.019 [2024-10-16 07:21:23.787104] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.019 [2024-10-16 07:21:23.787117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.019 [2024-10-16 07:21:23.787124] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787130] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=8192, cccid=5 00:23:21.019 [2024-10-16 07:21:23.787138] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c210) on tqpair(0xa1be10): expected_datao=0, payload_size=8192 00:23:21.019 [2024-10-16 07:21:23.787156] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787165] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.019 [2024-10-16 07:21:23.787187] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.019 [2024-10-16 07:21:23.787194] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787200] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=512, cccid=4 00:23:21.019 [2024-10-16 07:21:23.787208] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c0b0) on tqpair(0xa1be10): expected_datao=0, payload_size=512 00:23:21.019 [2024-10-16 07:21:23.787218] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787225] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787233] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.019 [2024-10-16 07:21:23.787242] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.019 [2024-10-16 07:21:23.787248] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787254] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=512, cccid=6 00:23:21.019 [2024-10-16 07:21:23.787262] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c370) on tqpair(0xa1be10): expected_datao=0, payload_size=512 00:23:21.019 [2024-10-16 07:21:23.787272] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787279] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787287] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:21.019 [2024-10-16 07:21:23.787296] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:21.019 [2024-10-16 07:21:23.787302] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787308] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xa1be10): datao=0, datal=4096, cccid=7 00:23:21.019 [2024-10-16 07:21:23.787316] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa9c4d0) on tqpair(0xa1be10): expected_datao=0, payload_size=4096 00:23:21.019 [2024-10-16 07:21:23.787326] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787333] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787344] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.787354] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.787360] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787366] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c210) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.787387] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.787398] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.787405] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787411] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c0b0) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.787427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.787438] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.787460] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787466] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c370) on tqpair=0xa1be10 00:23:21.019 [2024-10-16 07:21:23.787477] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.019 [2024-10-16 07:21:23.787486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.019 [2024-10-16 07:21:23.787492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.019 [2024-10-16 07:21:23.787499] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c4d0) on tqpair=0xa1be10 00:23:21.019 ===================================================== 00:23:21.019 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:21.019 ===================================================== 00:23:21.019 Controller Capabilities/Features 00:23:21.019 ================================ 00:23:21.019 Vendor ID: 8086 00:23:21.019 Subsystem Vendor ID: 8086 00:23:21.019 Serial Number: SPDK00000000000001 00:23:21.019 Model Number: SPDK bdev Controller 00:23:21.019 Firmware Version: 24.01.1 00:23:21.019 Recommended Arb Burst: 6 00:23:21.019 IEEE OUI Identifier: e4 d2 5c 00:23:21.019 Multi-path I/O 00:23:21.019 May have multiple subsystem ports: Yes 00:23:21.019 May have multiple controllers: Yes 00:23:21.019 Associated with SR-IOV VF: No 00:23:21.019 Max Data Transfer Size: 131072 00:23:21.019 Max Number of Namespaces: 32 00:23:21.019 Max Number of I/O Queues: 127 00:23:21.019 NVMe Specification Version (VS): 1.3 00:23:21.019 NVMe Specification Version (Identify): 1.3 00:23:21.019 Maximum Queue Entries: 128 00:23:21.020 Contiguous Queues Required: Yes 00:23:21.020 Arbitration Mechanisms Supported 00:23:21.020 Weighted Round Robin: Not Supported 00:23:21.020 Vendor Specific: Not Supported 00:23:21.020 Reset Timeout: 15000 ms 00:23:21.020 Doorbell Stride: 4 bytes 00:23:21.020 NVM Subsystem Reset: Not Supported 00:23:21.020 Command Sets Supported 00:23:21.020 NVM Command Set: Supported 00:23:21.020 Boot Partition: Not Supported 00:23:21.020 Memory Page Size Minimum: 4096 bytes 00:23:21.020 Memory Page Size Maximum: 4096 bytes 00:23:21.020 Persistent Memory Region: Not Supported 00:23:21.020 Optional Asynchronous Events Supported 00:23:21.020 Namespace Attribute Notices: Supported 00:23:21.020 Firmware Activation Notices: Not Supported 00:23:21.020 ANA Change Notices: Not Supported 00:23:21.020 PLE Aggregate Log Change Notices: Not Supported 00:23:21.020 LBA Status Info Alert Notices: Not Supported 00:23:21.020 EGE Aggregate Log Change Notices: Not Supported 00:23:21.020 Normal NVM Subsystem Shutdown event: Not Supported 00:23:21.020 Zone Descriptor Change Notices: Not Supported 00:23:21.020 Discovery Log Change Notices: Not Supported 00:23:21.020 Controller Attributes 00:23:21.020 128-bit Host Identifier: Supported 00:23:21.020 Non-Operational Permissive Mode: Not Supported 00:23:21.020 NVM Sets: Not Supported 00:23:21.020 Read Recovery Levels: Not Supported 00:23:21.020 Endurance Groups: Not Supported 00:23:21.020 Predictable Latency Mode: Not Supported 00:23:21.020 Traffic Based Keep ALive: Not Supported 00:23:21.020 Namespace Granularity: Not Supported 00:23:21.020 SQ Associations: Not Supported 00:23:21.020 UUID List: Not Supported 00:23:21.020 Multi-Domain Subsystem: Not Supported 00:23:21.020 Fixed Capacity Management: Not Supported 00:23:21.020 Variable Capacity Management: Not Supported 00:23:21.020 Delete Endurance Group: Not Supported 00:23:21.020 Delete NVM Set: Not Supported 00:23:21.020 Extended LBA Formats Supported: Not Supported 00:23:21.020 Flexible Data Placement Supported: Not Supported 00:23:21.020 00:23:21.020 Controller Memory Buffer Support 00:23:21.020 ================================ 00:23:21.020 Supported: No 00:23:21.020 00:23:21.020 Persistent Memory Region Support 00:23:21.020 ================================ 00:23:21.020 Supported: No 00:23:21.020 00:23:21.020 Admin Command Set Attributes 00:23:21.020 ============================ 00:23:21.020 Security Send/Receive: Not Supported 00:23:21.020 Format NVM: Not Supported 00:23:21.020 Firmware Activate/Download: Not Supported 00:23:21.020 Namespace Management: Not Supported 00:23:21.020 Device Self-Test: Not Supported 00:23:21.020 Directives: Not Supported 00:23:21.020 NVMe-MI: Not Supported 00:23:21.020 Virtualization Management: Not Supported 00:23:21.020 Doorbell Buffer Config: Not Supported 00:23:21.020 Get LBA Status Capability: Not Supported 00:23:21.020 Command & Feature Lockdown Capability: Not Supported 00:23:21.020 Abort Command Limit: 4 00:23:21.020 Async Event Request Limit: 4 00:23:21.020 Number of Firmware Slots: N/A 00:23:21.020 Firmware Slot 1 Read-Only: N/A 00:23:21.020 Firmware Activation Without Reset: N/A 00:23:21.020 Multiple Update Detection Support: N/A 00:23:21.020 Firmware Update Granularity: No Information Provided 00:23:21.020 Per-Namespace SMART Log: No 00:23:21.020 Asymmetric Namespace Access Log Page: Not Supported 00:23:21.020 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:21.020 Command Effects Log Page: Supported 00:23:21.020 Get Log Page Extended Data: Supported 00:23:21.020 Telemetry Log Pages: Not Supported 00:23:21.020 Persistent Event Log Pages: Not Supported 00:23:21.020 Supported Log Pages Log Page: May Support 00:23:21.020 Commands Supported & Effects Log Page: Not Supported 00:23:21.020 Feature Identifiers & Effects Log Page:May Support 00:23:21.020 NVMe-MI Commands & Effects Log Page: May Support 00:23:21.020 Data Area 4 for Telemetry Log: Not Supported 00:23:21.020 Error Log Page Entries Supported: 128 00:23:21.020 Keep Alive: Supported 00:23:21.020 Keep Alive Granularity: 10000 ms 00:23:21.020 00:23:21.020 NVM Command Set Attributes 00:23:21.020 ========================== 00:23:21.020 Submission Queue Entry Size 00:23:21.020 Max: 64 00:23:21.020 Min: 64 00:23:21.020 Completion Queue Entry Size 00:23:21.020 Max: 16 00:23:21.020 Min: 16 00:23:21.020 Number of Namespaces: 32 00:23:21.020 Compare Command: Supported 00:23:21.020 Write Uncorrectable Command: Not Supported 00:23:21.020 Dataset Management Command: Supported 00:23:21.020 Write Zeroes Command: Supported 00:23:21.020 Set Features Save Field: Not Supported 00:23:21.020 Reservations: Supported 00:23:21.020 Timestamp: Not Supported 00:23:21.020 Copy: Supported 00:23:21.020 Volatile Write Cache: Present 00:23:21.020 Atomic Write Unit (Normal): 1 00:23:21.020 Atomic Write Unit (PFail): 1 00:23:21.020 Atomic Compare & Write Unit: 1 00:23:21.020 Fused Compare & Write: Supported 00:23:21.020 Scatter-Gather List 00:23:21.020 SGL Command Set: Supported 00:23:21.020 SGL Keyed: Supported 00:23:21.020 SGL Bit Bucket Descriptor: Not Supported 00:23:21.020 SGL Metadata Pointer: Not Supported 00:23:21.020 Oversized SGL: Not Supported 00:23:21.020 SGL Metadata Address: Not Supported 00:23:21.020 SGL Offset: Supported 00:23:21.020 Transport SGL Data Block: Not Supported 00:23:21.020 Replay Protected Memory Block: Not Supported 00:23:21.020 00:23:21.020 Firmware Slot Information 00:23:21.020 ========================= 00:23:21.020 Active slot: 1 00:23:21.020 Slot 1 Firmware Revision: 24.01.1 00:23:21.020 00:23:21.020 00:23:21.020 Commands Supported and Effects 00:23:21.020 ============================== 00:23:21.020 Admin Commands 00:23:21.020 -------------- 00:23:21.020 Get Log Page (02h): Supported 00:23:21.020 Identify (06h): Supported 00:23:21.020 Abort (08h): Supported 00:23:21.020 Set Features (09h): Supported 00:23:21.020 Get Features (0Ah): Supported 00:23:21.020 Asynchronous Event Request (0Ch): Supported 00:23:21.020 Keep Alive (18h): Supported 00:23:21.020 I/O Commands 00:23:21.020 ------------ 00:23:21.020 Flush (00h): Supported LBA-Change 00:23:21.020 Write (01h): Supported LBA-Change 00:23:21.020 Read (02h): Supported 00:23:21.020 Compare (05h): Supported 00:23:21.020 Write Zeroes (08h): Supported LBA-Change 00:23:21.020 Dataset Management (09h): Supported LBA-Change 00:23:21.020 Copy (19h): Supported LBA-Change 00:23:21.020 Unknown (79h): Supported LBA-Change 00:23:21.020 Unknown (7Ah): Supported 00:23:21.020 00:23:21.020 Error Log 00:23:21.020 ========= 00:23:21.020 00:23:21.020 Arbitration 00:23:21.020 =========== 00:23:21.020 Arbitration Burst: 1 00:23:21.020 00:23:21.020 Power Management 00:23:21.020 ================ 00:23:21.020 Number of Power States: 1 00:23:21.020 Current Power State: Power State #0 00:23:21.020 Power State #0: 00:23:21.020 Max Power: 0.00 W 00:23:21.020 Non-Operational State: Operational 00:23:21.020 Entry Latency: Not Reported 00:23:21.020 Exit Latency: Not Reported 00:23:21.020 Relative Read Throughput: 0 00:23:21.020 Relative Read Latency: 0 00:23:21.020 Relative Write Throughput: 0 00:23:21.020 Relative Write Latency: 0 00:23:21.020 Idle Power: Not Reported 00:23:21.020 Active Power: Not Reported 00:23:21.020 Non-Operational Permissive Mode: Not Supported 00:23:21.020 00:23:21.020 Health Information 00:23:21.020 ================== 00:23:21.020 Critical Warnings: 00:23:21.020 Available Spare Space: OK 00:23:21.020 Temperature: OK 00:23:21.020 Device Reliability: OK 00:23:21.020 Read Only: No 00:23:21.020 Volatile Memory Backup: OK 00:23:21.020 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:21.020 Temperature Threshold: [2024-10-16 07:21:23.787643] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.020 [2024-10-16 07:21:23.787654] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.020 [2024-10-16 07:21:23.787661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xa1be10) 00:23:21.020 [2024-10-16 07:21:23.787671] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.020 [2024-10-16 07:21:23.787693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9c4d0, cid 7, qid 0 00:23:21.020 [2024-10-16 07:21:23.787861] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.020 [2024-10-16 07:21:23.787877] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.020 [2024-10-16 07:21:23.787884] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.020 [2024-10-16 07:21:23.787891] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9c4d0) on tqpair=0xa1be10 00:23:21.020 [2024-10-16 07:21:23.787930] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:21.020 [2024-10-16 07:21:23.787951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.020 [2024-10-16 07:21:23.787963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.020 [2024-10-16 07:21:23.787973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.020 [2024-10-16 07:21:23.787982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:21.021 [2024-10-16 07:21:23.787994] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788008] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.788124] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.788138] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.788145] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788152] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.788162] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788170] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788176] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788187] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788217] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.788318] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.788330] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.788337] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788344] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.788352] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:21.021 [2024-10-16 07:21:23.788360] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:21.021 [2024-10-16 07:21:23.788375] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788384] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788390] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788400] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788421] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.788497] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.788509] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.788516] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788523] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.788539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788547] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788554] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788564] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788585] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.788663] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.788675] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.788682] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788689] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.788704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788719] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788737] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788759] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.788844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.788858] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.788865] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788871] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.788888] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788896] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.788903] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.788917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.788939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.789020] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.789034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.789041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789048] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.789064] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789073] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789079] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.789090] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.789111] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.789194] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.789208] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.789215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789222] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.789238] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789246] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789253] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.789263] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.789285] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.789375] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.789389] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.789396] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.789419] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789434] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.789444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.789465] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.789577] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.789591] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.789598] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789604] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.789620] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.789636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.789646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.789671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.793759] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.793776] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.793783] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.793790] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.021 [2024-10-16 07:21:23.793807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.793816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.793823] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xa1be10) 00:23:21.021 [2024-10-16 07:21:23.793833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:21.021 [2024-10-16 07:21:23.793856] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa9bf50, cid 3, qid 0 00:23:21.021 [2024-10-16 07:21:23.793982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:21.021 [2024-10-16 07:21:23.793997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:21.021 [2024-10-16 07:21:23.794004] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:21.021 [2024-10-16 07:21:23.794011] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa9bf50) on tqpair=0xa1be10 00:23:21.022 [2024-10-16 07:21:23.794024] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:21.022 0 Kelvin (-273 Celsius) 00:23:21.022 Available Spare: 0% 00:23:21.022 Available Spare Threshold: 0% 00:23:21.022 Life Percentage Used: 0% 00:23:21.022 Data Units Read: 0 00:23:21.022 Data Units Written: 0 00:23:21.022 Host Read Commands: 0 00:23:21.022 Host Write Commands: 0 00:23:21.022 Controller Busy Time: 0 minutes 00:23:21.022 Power Cycles: 0 00:23:21.022 Power On Hours: 0 hours 00:23:21.022 Unsafe Shutdowns: 0 00:23:21.022 Unrecoverable Media Errors: 0 00:23:21.022 Lifetime Error Log Entries: 0 00:23:21.022 Warning Temperature Time: 0 minutes 00:23:21.022 Critical Temperature Time: 0 minutes 00:23:21.022 00:23:21.022 Number of Queues 00:23:21.022 ================ 00:23:21.022 Number of I/O Submission Queues: 127 00:23:21.022 Number of I/O Completion Queues: 127 00:23:21.022 00:23:21.022 Active Namespaces 00:23:21.022 ================= 00:23:21.022 Namespace ID:1 00:23:21.022 Error Recovery Timeout: Unlimited 00:23:21.022 Command Set Identifier: NVM (00h) 00:23:21.022 Deallocate: Supported 00:23:21.022 Deallocated/Unwritten Error: Not Supported 00:23:21.022 Deallocated Read Value: Unknown 00:23:21.022 Deallocate in Write Zeroes: Not Supported 00:23:21.022 Deallocated Guard Field: 0xFFFF 00:23:21.022 Flush: Supported 00:23:21.022 Reservation: Supported 00:23:21.022 Namespace Sharing Capabilities: Multiple Controllers 00:23:21.022 Size (in LBAs): 131072 (0GiB) 00:23:21.022 Capacity (in LBAs): 131072 (0GiB) 00:23:21.022 Utilization (in LBAs): 131072 (0GiB) 00:23:21.022 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:21.022 EUI64: ABCDEF0123456789 00:23:21.022 UUID: b78ff91f-f937-45ca-aa95-dbf04f1c1395 00:23:21.022 Thin Provisioning: Not Supported 00:23:21.022 Per-NS Atomic Units: Yes 00:23:21.022 Atomic Boundary Size (Normal): 0 00:23:21.022 Atomic Boundary Size (PFail): 0 00:23:21.022 Atomic Boundary Offset: 0 00:23:21.022 Maximum Single Source Range Length: 65535 00:23:21.022 Maximum Copy Length: 65535 00:23:21.022 Maximum Source Range Count: 1 00:23:21.022 NGUID/EUI64 Never Reused: No 00:23:21.022 Namespace Write Protected: No 00:23:21.022 Number of LBA Formats: 1 00:23:21.022 Current LBA Format: LBA Format #00 00:23:21.022 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:21.022 00:23:21.022 07:21:23 -- host/identify.sh@51 -- # sync 00:23:21.022 07:21:23 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:21.022 07:21:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:21.022 07:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:21.022 07:21:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:21.022 07:21:23 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:21.022 07:21:23 -- host/identify.sh@56 -- # nvmftestfini 00:23:21.022 07:21:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:21.022 07:21:23 -- nvmf/common.sh@116 -- # sync 00:23:21.022 07:21:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:21.022 07:21:23 -- nvmf/common.sh@119 -- # set +e 00:23:21.022 07:21:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:21.022 07:21:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:21.022 rmmod nvme_tcp 00:23:21.022 rmmod nvme_fabrics 00:23:21.022 rmmod nvme_keyring 00:23:21.022 07:21:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:21.022 07:21:23 -- nvmf/common.sh@123 -- # set -e 00:23:21.022 07:21:23 -- nvmf/common.sh@124 -- # return 0 00:23:21.022 07:21:23 -- nvmf/common.sh@477 -- # '[' -n 1979415 ']' 00:23:21.022 07:21:23 -- nvmf/common.sh@478 -- # killprocess 1979415 00:23:21.022 07:21:23 -- common/autotest_common.sh@926 -- # '[' -z 1979415 ']' 00:23:21.022 07:21:23 -- common/autotest_common.sh@930 -- # kill -0 1979415 00:23:21.022 07:21:23 -- common/autotest_common.sh@931 -- # uname 00:23:21.022 07:21:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:21.022 07:21:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1979415 00:23:21.022 07:21:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:21.022 07:21:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:21.022 07:21:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1979415' 00:23:21.022 killing process with pid 1979415 00:23:21.022 07:21:23 -- common/autotest_common.sh@945 -- # kill 1979415 00:23:21.022 [2024-10-16 07:21:23.914189] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:21.022 07:21:23 -- common/autotest_common.sh@950 -- # wait 1979415 00:23:21.280 07:21:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:21.281 07:21:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:21.281 07:21:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:21.281 07:21:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:21.281 07:21:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:21.281 07:21:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.281 07:21:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.281 07:21:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.880 07:21:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:23.880 00:23:23.880 real 0m6.159s 00:23:23.880 user 0m7.368s 00:23:23.880 sys 0m1.915s 00:23:23.880 07:21:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:23.880 07:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:23.880 ************************************ 00:23:23.880 END TEST nvmf_identify 00:23:23.880 ************************************ 00:23:23.880 07:21:26 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:23.880 07:21:26 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:23.880 07:21:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:23.880 07:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:23.880 ************************************ 00:23:23.880 START TEST nvmf_perf 00:23:23.880 ************************************ 00:23:23.880 07:21:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:23.880 * Looking for test storage... 00:23:23.880 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:23.880 07:21:26 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:23.880 07:21:26 -- nvmf/common.sh@7 -- # uname -s 00:23:23.880 07:21:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:23.880 07:21:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:23.880 07:21:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:23.880 07:21:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:23.880 07:21:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:23.880 07:21:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:23.880 07:21:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:23.880 07:21:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:23.880 07:21:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:23.880 07:21:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:23.880 07:21:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.880 07:21:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.880 07:21:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:23.880 07:21:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:23.880 07:21:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:23.880 07:21:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:23.880 07:21:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:23.880 07:21:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:23.880 07:21:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:23.880 07:21:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.880 07:21:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.880 07:21:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.880 07:21:26 -- paths/export.sh@5 -- # export PATH 00:23:23.880 07:21:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.880 07:21:26 -- nvmf/common.sh@46 -- # : 0 00:23:23.880 07:21:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:23.880 07:21:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:23.880 07:21:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:23.880 07:21:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:23.880 07:21:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:23.880 07:21:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:23.880 07:21:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:23.880 07:21:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:23.880 07:21:26 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:23.880 07:21:26 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:23.880 07:21:26 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:23.880 07:21:26 -- host/perf.sh@17 -- # nvmftestinit 00:23:23.880 07:21:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:23.880 07:21:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:23.880 07:21:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:23.880 07:21:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:23.880 07:21:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:23.880 07:21:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.880 07:21:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:23.880 07:21:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.880 07:21:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:23.880 07:21:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:23.880 07:21:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:23.880 07:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:25.823 07:21:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:25.823 07:21:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:25.823 07:21:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:25.823 07:21:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:25.823 07:21:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:25.823 07:21:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:25.823 07:21:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:25.823 07:21:28 -- nvmf/common.sh@294 -- # net_devs=() 00:23:25.823 07:21:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:25.823 07:21:28 -- nvmf/common.sh@295 -- # e810=() 00:23:25.823 07:21:28 -- nvmf/common.sh@295 -- # local -ga e810 00:23:25.823 07:21:28 -- nvmf/common.sh@296 -- # x722=() 00:23:25.823 07:21:28 -- nvmf/common.sh@296 -- # local -ga x722 00:23:25.823 07:21:28 -- nvmf/common.sh@297 -- # mlx=() 00:23:25.823 07:21:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:25.824 07:21:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:25.824 07:21:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.824 07:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:25.824 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:25.824 07:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.824 07:21:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:25.824 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:25.824 07:21:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.824 07:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.824 07:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.824 07:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:25.824 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:25.824 07:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.824 07:21:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.824 07:21:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.824 07:21:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:25.824 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:25.824 07:21:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:25.824 07:21:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:25.824 07:21:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:25.824 07:21:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:25.824 07:21:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:25.824 07:21:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:25.824 07:21:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:25.824 07:21:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:25.824 07:21:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:25.824 07:21:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:25.824 07:21:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:25.824 07:21:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:25.824 07:21:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:25.824 07:21:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:25.824 07:21:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:25.824 07:21:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:25.824 07:21:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:25.824 07:21:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:25.824 07:21:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:25.824 07:21:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:25.824 07:21:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:25.824 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:25.824 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:23:25.824 00:23:25.824 --- 10.0.0.2 ping statistics --- 00:23:25.824 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.824 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:23:25.824 07:21:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:25.824 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:25.824 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:23:25.824 00:23:25.824 --- 10.0.0.1 ping statistics --- 00:23:25.824 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.824 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:23:25.824 07:21:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:25.824 07:21:28 -- nvmf/common.sh@410 -- # return 0 00:23:25.824 07:21:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:25.824 07:21:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:25.824 07:21:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:25.824 07:21:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:25.824 07:21:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:25.824 07:21:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:25.824 07:21:28 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:25.824 07:21:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:25.824 07:21:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:25.824 07:21:28 -- common/autotest_common.sh@10 -- # set +x 00:23:25.824 07:21:28 -- nvmf/common.sh@469 -- # nvmfpid=1981524 00:23:25.824 07:21:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:25.824 07:21:28 -- nvmf/common.sh@470 -- # waitforlisten 1981524 00:23:25.824 07:21:28 -- common/autotest_common.sh@819 -- # '[' -z 1981524 ']' 00:23:25.824 07:21:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:25.824 07:21:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:25.824 07:21:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:25.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:25.824 07:21:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:25.824 07:21:28 -- common/autotest_common.sh@10 -- # set +x 00:23:25.824 [2024-10-16 07:21:28.503568] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:23:25.824 [2024-10-16 07:21:28.503655] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:25.824 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.824 [2024-10-16 07:21:28.571719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:25.824 [2024-10-16 07:21:28.687169] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:25.824 [2024-10-16 07:21:28.687336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:25.824 [2024-10-16 07:21:28.687357] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:25.824 [2024-10-16 07:21:28.687371] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:25.824 [2024-10-16 07:21:28.687465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:25.824 [2024-10-16 07:21:28.687523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:25.824 [2024-10-16 07:21:28.687643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:25.824 [2024-10-16 07:21:28.687645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:26.757 07:21:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:26.757 07:21:29 -- common/autotest_common.sh@852 -- # return 0 00:23:26.757 07:21:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:26.757 07:21:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:26.757 07:21:29 -- common/autotest_common.sh@10 -- # set +x 00:23:26.757 07:21:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:26.757 07:21:29 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:26.757 07:21:29 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:30.037 07:21:32 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:30.037 07:21:32 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:30.037 07:21:32 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:30.037 07:21:32 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:30.295 07:21:33 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:30.295 07:21:33 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:30.295 07:21:33 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:30.295 07:21:33 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:30.295 07:21:33 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:30.553 [2024-10-16 07:21:33.443067] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:30.553 07:21:33 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:30.810 07:21:33 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:30.810 07:21:33 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:31.068 07:21:33 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:31.068 07:21:33 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:31.327 07:21:34 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:31.585 [2024-10-16 07:21:34.442924] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:31.585 07:21:34 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:31.843 07:21:34 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:31.843 07:21:34 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:31.843 07:21:34 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:31.843 07:21:34 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:33.217 Initializing NVMe Controllers 00:23:33.217 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:33.217 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:33.217 Initialization complete. Launching workers. 00:23:33.217 ======================================================== 00:23:33.217 Latency(us) 00:23:33.217 Device Information : IOPS MiB/s Average min max 00:23:33.217 PCIE (0000:88:00.0) NSID 1 from core 0: 86714.26 338.73 368.51 41.33 7256.14 00:23:33.217 ======================================================== 00:23:33.217 Total : 86714.26 338.73 368.51 41.33 7256.14 00:23:33.217 00:23:33.217 07:21:35 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:33.217 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.590 Initializing NVMe Controllers 00:23:34.590 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:34.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:34.590 Initialization complete. Launching workers. 00:23:34.590 ======================================================== 00:23:34.590 Latency(us) 00:23:34.590 Device Information : IOPS MiB/s Average min max 00:23:34.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 121.57 0.47 8552.48 139.02 45420.51 00:23:34.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.82 0.20 19451.23 7930.64 47900.20 00:23:34.590 ======================================================== 00:23:34.590 Total : 173.38 0.68 11809.58 139.02 47900.20 00:23:34.590 00:23:34.590 07:21:37 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:34.590 EAL: No free 2048 kB hugepages reported on node 1 00:23:35.523 Initializing NVMe Controllers 00:23:35.523 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:35.523 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:35.523 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:35.523 Initialization complete. Launching workers. 00:23:35.523 ======================================================== 00:23:35.523 Latency(us) 00:23:35.523 Device Information : IOPS MiB/s Average min max 00:23:35.523 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8589.75 33.55 3738.21 559.42 7485.28 00:23:35.523 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3856.89 15.07 8335.35 5226.99 18748.10 00:23:35.523 ======================================================== 00:23:35.523 Total : 12446.64 48.62 5162.74 559.42 18748.10 00:23:35.523 00:23:35.523 07:21:38 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:35.523 07:21:38 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:35.523 07:21:38 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:35.523 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.806 Initializing NVMe Controllers 00:23:38.806 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:38.806 Controller IO queue size 128, less than required. 00:23:38.806 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.806 Controller IO queue size 128, less than required. 00:23:38.806 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.806 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:38.806 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:38.806 Initialization complete. Launching workers. 00:23:38.806 ======================================================== 00:23:38.806 Latency(us) 00:23:38.806 Device Information : IOPS MiB/s Average min max 00:23:38.806 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1647.58 411.90 78997.91 56559.83 119900.01 00:23:38.806 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 639.37 159.84 213216.16 77108.00 326396.12 00:23:38.806 ======================================================== 00:23:38.806 Total : 2286.95 571.74 116521.61 56559.83 326396.12 00:23:38.806 00:23:38.806 07:21:41 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:38.806 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.806 No valid NVMe controllers or AIO or URING devices found 00:23:38.806 Initializing NVMe Controllers 00:23:38.806 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:38.806 Controller IO queue size 128, less than required. 00:23:38.806 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.806 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:38.806 Controller IO queue size 128, less than required. 00:23:38.806 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:38.806 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:38.806 WARNING: Some requested NVMe devices were skipped 00:23:38.806 07:21:41 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:38.806 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.337 Initializing NVMe Controllers 00:23:41.337 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.337 Controller IO queue size 128, less than required. 00:23:41.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.337 Controller IO queue size 128, less than required. 00:23:41.337 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.337 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.337 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.337 Initialization complete. Launching workers. 00:23:41.337 00:23:41.337 ==================== 00:23:41.337 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:41.337 TCP transport: 00:23:41.337 polls: 10655 00:23:41.337 idle_polls: 7948 00:23:41.337 sock_completions: 2707 00:23:41.337 nvme_completions: 5059 00:23:41.337 submitted_requests: 7726 00:23:41.337 queued_requests: 1 00:23:41.337 00:23:41.337 ==================== 00:23:41.337 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:41.337 TCP transport: 00:23:41.337 polls: 11105 00:23:41.337 idle_polls: 8535 00:23:41.337 sock_completions: 2570 00:23:41.337 nvme_completions: 4858 00:23:41.337 submitted_requests: 7452 00:23:41.337 queued_requests: 1 00:23:41.337 ======================================================== 00:23:41.337 Latency(us) 00:23:41.337 Device Information : IOPS MiB/s Average min max 00:23:41.337 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1327.72 331.93 98166.26 63598.55 133759.03 00:23:41.337 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1277.73 319.43 102027.10 49138.88 159670.94 00:23:41.337 ======================================================== 00:23:41.337 Total : 2605.45 651.36 100059.64 49138.88 159670.94 00:23:41.337 00:23:41.337 07:21:43 -- host/perf.sh@66 -- # sync 00:23:41.337 07:21:43 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:41.337 07:21:44 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:41.337 07:21:44 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:41.337 07:21:44 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:44.612 07:21:47 -- host/perf.sh@72 -- # ls_guid=d596717e-2e30-498c-b830-b064355fdcd4 00:23:44.612 07:21:47 -- host/perf.sh@73 -- # get_lvs_free_mb d596717e-2e30-498c-b830-b064355fdcd4 00:23:44.612 07:21:47 -- common/autotest_common.sh@1343 -- # local lvs_uuid=d596717e-2e30-498c-b830-b064355fdcd4 00:23:44.612 07:21:47 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:44.612 07:21:47 -- common/autotest_common.sh@1345 -- # local fc 00:23:44.612 07:21:47 -- common/autotest_common.sh@1346 -- # local cs 00:23:44.612 07:21:47 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:44.869 07:21:47 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:44.869 { 00:23:44.869 "uuid": "d596717e-2e30-498c-b830-b064355fdcd4", 00:23:44.869 "name": "lvs_0", 00:23:44.869 "base_bdev": "Nvme0n1", 00:23:44.869 "total_data_clusters": 238234, 00:23:44.869 "free_clusters": 238234, 00:23:44.869 "block_size": 512, 00:23:44.869 "cluster_size": 4194304 00:23:44.869 } 00:23:44.869 ]' 00:23:44.869 07:21:47 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="d596717e-2e30-498c-b830-b064355fdcd4") .free_clusters' 00:23:44.869 07:21:47 -- common/autotest_common.sh@1348 -- # fc=238234 00:23:44.869 07:21:47 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="d596717e-2e30-498c-b830-b064355fdcd4") .cluster_size' 00:23:44.869 07:21:47 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:44.869 07:21:47 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:23:44.869 07:21:47 -- common/autotest_common.sh@1353 -- # echo 952936 00:23:44.869 952936 00:23:44.869 07:21:47 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:44.869 07:21:47 -- host/perf.sh@78 -- # free_mb=20480 00:23:44.869 07:21:47 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d596717e-2e30-498c-b830-b064355fdcd4 lbd_0 20480 00:23:45.435 07:21:48 -- host/perf.sh@80 -- # lb_guid=b8cd5285-7fe3-4aa6-a02f-88c9e5b6cbf1 00:23:45.435 07:21:48 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore b8cd5285-7fe3-4aa6-a02f-88c9e5b6cbf1 lvs_n_0 00:23:46.368 07:21:49 -- host/perf.sh@83 -- # ls_nested_guid=15991596-d2a0-425a-a135-5d539879a40c 00:23:46.368 07:21:49 -- host/perf.sh@84 -- # get_lvs_free_mb 15991596-d2a0-425a-a135-5d539879a40c 00:23:46.368 07:21:49 -- common/autotest_common.sh@1343 -- # local lvs_uuid=15991596-d2a0-425a-a135-5d539879a40c 00:23:46.368 07:21:49 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:46.368 07:21:49 -- common/autotest_common.sh@1345 -- # local fc 00:23:46.368 07:21:49 -- common/autotest_common.sh@1346 -- # local cs 00:23:46.368 07:21:49 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:46.626 07:21:49 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:46.626 { 00:23:46.626 "uuid": "d596717e-2e30-498c-b830-b064355fdcd4", 00:23:46.626 "name": "lvs_0", 00:23:46.626 "base_bdev": "Nvme0n1", 00:23:46.626 "total_data_clusters": 238234, 00:23:46.626 "free_clusters": 233114, 00:23:46.626 "block_size": 512, 00:23:46.626 "cluster_size": 4194304 00:23:46.626 }, 00:23:46.626 { 00:23:46.626 "uuid": "15991596-d2a0-425a-a135-5d539879a40c", 00:23:46.626 "name": "lvs_n_0", 00:23:46.626 "base_bdev": "b8cd5285-7fe3-4aa6-a02f-88c9e5b6cbf1", 00:23:46.626 "total_data_clusters": 5114, 00:23:46.626 "free_clusters": 5114, 00:23:46.626 "block_size": 512, 00:23:46.626 "cluster_size": 4194304 00:23:46.626 } 00:23:46.626 ]' 00:23:46.626 07:21:49 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="15991596-d2a0-425a-a135-5d539879a40c") .free_clusters' 00:23:46.626 07:21:49 -- common/autotest_common.sh@1348 -- # fc=5114 00:23:46.626 07:21:49 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="15991596-d2a0-425a-a135-5d539879a40c") .cluster_size' 00:23:46.626 07:21:49 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:46.626 07:21:49 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:23:46.626 07:21:49 -- common/autotest_common.sh@1353 -- # echo 20456 00:23:46.626 20456 00:23:46.626 07:21:49 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:46.626 07:21:49 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 15991596-d2a0-425a-a135-5d539879a40c lbd_nest_0 20456 00:23:46.884 07:21:49 -- host/perf.sh@88 -- # lb_nested_guid=64299167-d8a9-4ebf-b632-e9dcf6a4951b 00:23:46.884 07:21:49 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:47.141 07:21:49 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:47.141 07:21:49 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 64299167-d8a9-4ebf-b632-e9dcf6a4951b 00:23:47.399 07:21:50 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:47.656 07:21:50 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:47.656 07:21:50 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:47.656 07:21:50 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:47.656 07:21:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:47.656 07:21:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:47.656 EAL: No free 2048 kB hugepages reported on node 1 00:23:59.850 Initializing NVMe Controllers 00:23:59.850 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:59.850 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:59.850 Initialization complete. Launching workers. 00:23:59.850 ======================================================== 00:23:59.850 Latency(us) 00:23:59.850 Device Information : IOPS MiB/s Average min max 00:23:59.850 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 51.70 0.03 19344.98 171.19 49495.38 00:23:59.851 ======================================================== 00:23:59.851 Total : 51.70 0.03 19344.98 171.19 49495.38 00:23:59.851 00:23:59.851 07:22:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:59.851 07:22:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:59.851 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.815 Initializing NVMe Controllers 00:24:09.815 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:09.815 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:09.815 Initialization complete. Launching workers. 00:24:09.815 ======================================================== 00:24:09.815 Latency(us) 00:24:09.815 Device Information : IOPS MiB/s Average min max 00:24:09.815 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 68.00 8.50 14712.02 4984.08 51837.11 00:24:09.815 ======================================================== 00:24:09.815 Total : 68.00 8.50 14712.02 4984.08 51837.11 00:24:09.815 00:24:09.815 07:22:10 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:09.815 07:22:10 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:09.815 07:22:10 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:09.815 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.792 Initializing NVMe Controllers 00:24:19.792 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:19.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:19.792 Initialization complete. Launching workers. 00:24:19.792 ======================================================== 00:24:19.792 Latency(us) 00:24:19.792 Device Information : IOPS MiB/s Average min max 00:24:19.792 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7860.40 3.84 4071.33 276.02 10616.99 00:24:19.792 ======================================================== 00:24:19.792 Total : 7860.40 3.84 4071.33 276.02 10616.99 00:24:19.792 00:24:19.792 07:22:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:19.792 07:22:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:19.792 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.836 Initializing NVMe Controllers 00:24:29.836 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:29.836 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:29.837 Initialization complete. Launching workers. 00:24:29.837 ======================================================== 00:24:29.837 Latency(us) 00:24:29.837 Device Information : IOPS MiB/s Average min max 00:24:29.837 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4097.37 512.17 7809.56 649.66 17559.38 00:24:29.837 ======================================================== 00:24:29.837 Total : 4097.37 512.17 7809.56 649.66 17559.38 00:24:29.837 00:24:29.837 07:22:31 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:29.837 07:22:31 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:29.837 07:22:31 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:29.837 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.807 Initializing NVMe Controllers 00:24:39.807 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:39.807 Controller IO queue size 128, less than required. 00:24:39.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:39.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:39.807 Initialization complete. Launching workers. 00:24:39.807 ======================================================== 00:24:39.807 Latency(us) 00:24:39.807 Device Information : IOPS MiB/s Average min max 00:24:39.807 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12140.29 5.93 10546.62 1741.28 26860.51 00:24:39.807 ======================================================== 00:24:39.807 Total : 12140.29 5.93 10546.62 1741.28 26860.51 00:24:39.807 00:24:39.807 07:22:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:39.807 07:22:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:39.807 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.784 Initializing NVMe Controllers 00:24:49.784 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:49.784 Controller IO queue size 128, less than required. 00:24:49.784 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:49.784 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:49.784 Initialization complete. Launching workers. 00:24:49.784 ======================================================== 00:24:49.784 Latency(us) 00:24:49.784 Device Information : IOPS MiB/s Average min max 00:24:49.784 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1197.76 149.72 107507.28 15719.93 218640.23 00:24:49.784 ======================================================== 00:24:49.784 Total : 1197.76 149.72 107507.28 15719.93 218640.23 00:24:49.784 00:24:49.784 07:22:52 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:49.784 07:22:52 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 64299167-d8a9-4ebf-b632-e9dcf6a4951b 00:24:50.349 07:22:53 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:50.607 07:22:53 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b8cd5285-7fe3-4aa6-a02f-88c9e5b6cbf1 00:24:50.865 07:22:53 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:51.123 07:22:53 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:51.123 07:22:53 -- host/perf.sh@114 -- # nvmftestfini 00:24:51.123 07:22:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:51.123 07:22:53 -- nvmf/common.sh@116 -- # sync 00:24:51.123 07:22:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:51.123 07:22:53 -- nvmf/common.sh@119 -- # set +e 00:24:51.123 07:22:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:51.123 07:22:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:51.123 rmmod nvme_tcp 00:24:51.123 rmmod nvme_fabrics 00:24:51.123 rmmod nvme_keyring 00:24:51.123 07:22:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:51.123 07:22:53 -- nvmf/common.sh@123 -- # set -e 00:24:51.123 07:22:53 -- nvmf/common.sh@124 -- # return 0 00:24:51.123 07:22:53 -- nvmf/common.sh@477 -- # '[' -n 1981524 ']' 00:24:51.123 07:22:53 -- nvmf/common.sh@478 -- # killprocess 1981524 00:24:51.123 07:22:53 -- common/autotest_common.sh@926 -- # '[' -z 1981524 ']' 00:24:51.123 07:22:53 -- common/autotest_common.sh@930 -- # kill -0 1981524 00:24:51.123 07:22:53 -- common/autotest_common.sh@931 -- # uname 00:24:51.123 07:22:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:51.123 07:22:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1981524 00:24:51.123 07:22:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:51.123 07:22:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:51.123 07:22:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1981524' 00:24:51.123 killing process with pid 1981524 00:24:51.123 07:22:54 -- common/autotest_common.sh@945 -- # kill 1981524 00:24:51.123 07:22:54 -- common/autotest_common.sh@950 -- # wait 1981524 00:24:53.020 07:22:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:53.020 07:22:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:53.020 07:22:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:53.020 07:22:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:53.020 07:22:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:53.020 07:22:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.020 07:22:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.020 07:22:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:54.922 07:22:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:54.922 00:24:54.922 real 1m31.438s 00:24:54.922 user 5m38.658s 00:24:54.922 sys 0m15.133s 00:24:54.922 07:22:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:54.922 07:22:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.922 ************************************ 00:24:54.922 END TEST nvmf_perf 00:24:54.922 ************************************ 00:24:54.922 07:22:57 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:54.922 07:22:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:54.922 07:22:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:54.922 07:22:57 -- common/autotest_common.sh@10 -- # set +x 00:24:54.922 ************************************ 00:24:54.922 START TEST nvmf_fio_host 00:24:54.922 ************************************ 00:24:54.922 07:22:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:54.922 * Looking for test storage... 00:24:54.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:54.922 07:22:57 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:54.922 07:22:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:54.922 07:22:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:54.922 07:22:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:54.922 07:22:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.922 07:22:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.922 07:22:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.922 07:22:57 -- paths/export.sh@5 -- # export PATH 00:24:54.923 07:22:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.923 07:22:57 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:54.923 07:22:57 -- nvmf/common.sh@7 -- # uname -s 00:24:54.923 07:22:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:54.923 07:22:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:54.923 07:22:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:54.923 07:22:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:54.923 07:22:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:54.923 07:22:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:54.923 07:22:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:54.923 07:22:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:54.923 07:22:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:54.923 07:22:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:54.923 07:22:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:54.923 07:22:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:54.923 07:22:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:54.923 07:22:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:54.923 07:22:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:54.923 07:22:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:54.923 07:22:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:54.923 07:22:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:54.923 07:22:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:54.923 07:22:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.923 07:22:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.923 07:22:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.923 07:22:57 -- paths/export.sh@5 -- # export PATH 00:24:54.923 07:22:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.923 07:22:57 -- nvmf/common.sh@46 -- # : 0 00:24:54.923 07:22:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:54.923 07:22:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:54.923 07:22:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:54.923 07:22:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:54.923 07:22:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:54.923 07:22:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:54.923 07:22:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:54.923 07:22:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:54.923 07:22:57 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:54.923 07:22:57 -- host/fio.sh@14 -- # nvmftestinit 00:24:54.923 07:22:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:54.923 07:22:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:54.923 07:22:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:54.923 07:22:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:54.923 07:22:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:54.923 07:22:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.923 07:22:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.923 07:22:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:54.923 07:22:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:54.923 07:22:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:54.923 07:22:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:54.923 07:22:57 -- common/autotest_common.sh@10 -- # set +x 00:24:56.822 07:22:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:56.822 07:22:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:56.822 07:22:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:56.822 07:22:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:56.822 07:22:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:56.822 07:22:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:56.822 07:22:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:56.822 07:22:59 -- nvmf/common.sh@294 -- # net_devs=() 00:24:56.822 07:22:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:56.822 07:22:59 -- nvmf/common.sh@295 -- # e810=() 00:24:56.822 07:22:59 -- nvmf/common.sh@295 -- # local -ga e810 00:24:56.822 07:22:59 -- nvmf/common.sh@296 -- # x722=() 00:24:56.822 07:22:59 -- nvmf/common.sh@296 -- # local -ga x722 00:24:56.822 07:22:59 -- nvmf/common.sh@297 -- # mlx=() 00:24:56.822 07:22:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:56.822 07:22:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:56.822 07:22:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:56.822 07:22:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:56.822 07:22:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:56.822 07:22:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:56.822 07:22:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:56.822 07:22:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:56.822 07:22:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.822 07:22:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:56.822 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:56.822 07:22:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.822 07:22:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.823 07:22:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:56.823 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:56.823 07:22:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:56.823 07:22:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.823 07:22:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.823 07:22:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.823 07:22:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.823 07:22:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:56.823 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:56.823 07:22:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.823 07:22:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.823 07:22:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.823 07:22:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.823 07:22:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.823 07:22:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:56.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:56.823 07:22:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.823 07:22:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:56.823 07:22:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:56.823 07:22:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:56.823 07:22:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:56.823 07:22:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:56.823 07:22:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:56.823 07:22:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:56.823 07:22:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:56.823 07:22:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:56.823 07:22:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:56.823 07:22:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:56.823 07:22:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:56.823 07:22:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:56.823 07:22:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:56.823 07:22:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:56.823 07:22:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:56.823 07:22:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:57.081 07:22:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:57.081 07:22:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:57.081 07:22:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:57.081 07:22:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:57.081 07:22:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:57.081 07:22:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:57.081 07:22:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:57.081 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:57.081 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:24:57.081 00:24:57.081 --- 10.0.0.2 ping statistics --- 00:24:57.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.082 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:24:57.082 07:22:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:57.082 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:57.082 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:24:57.082 00:24:57.082 --- 10.0.0.1 ping statistics --- 00:24:57.082 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.082 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:24:57.082 07:22:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:57.082 07:22:59 -- nvmf/common.sh@410 -- # return 0 00:24:57.082 07:22:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:57.082 07:22:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:57.082 07:22:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:57.082 07:22:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:57.082 07:22:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:57.082 07:22:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:57.082 07:22:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:57.082 07:22:59 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:57.082 07:22:59 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:57.082 07:22:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:57.082 07:22:59 -- common/autotest_common.sh@10 -- # set +x 00:24:57.082 07:22:59 -- host/fio.sh@24 -- # nvmfpid=1993955 00:24:57.082 07:22:59 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:57.082 07:22:59 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:57.082 07:22:59 -- host/fio.sh@28 -- # waitforlisten 1993955 00:24:57.082 07:22:59 -- common/autotest_common.sh@819 -- # '[' -z 1993955 ']' 00:24:57.082 07:22:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:57.082 07:22:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:57.082 07:22:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:57.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:57.082 07:22:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:57.082 07:22:59 -- common/autotest_common.sh@10 -- # set +x 00:24:57.082 [2024-10-16 07:22:59.971703] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:57.082 [2024-10-16 07:22:59.971789] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:57.082 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.340 [2024-10-16 07:23:00.042252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:57.340 [2024-10-16 07:23:00.158595] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:57.340 [2024-10-16 07:23:00.158789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:57.340 [2024-10-16 07:23:00.158811] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:57.340 [2024-10-16 07:23:00.158826] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:57.340 [2024-10-16 07:23:00.158910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:57.340 [2024-10-16 07:23:00.158994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:57.340 [2024-10-16 07:23:00.159088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:57.340 [2024-10-16 07:23:00.159090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:58.273 07:23:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:58.273 07:23:00 -- common/autotest_common.sh@852 -- # return 0 00:24:58.273 07:23:00 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:58.273 [2024-10-16 07:23:01.205137] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:58.530 07:23:01 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:58.530 07:23:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:58.530 07:23:01 -- common/autotest_common.sh@10 -- # set +x 00:24:58.530 07:23:01 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:58.788 Malloc1 00:24:58.788 07:23:01 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:59.046 07:23:01 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:59.303 07:23:02 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:59.561 [2024-10-16 07:23:02.265974] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.561 07:23:02 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:59.819 07:23:02 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:59.819 07:23:02 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.819 07:23:02 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.819 07:23:02 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:59.819 07:23:02 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:59.819 07:23:02 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:59.819 07:23:02 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.819 07:23:02 -- common/autotest_common.sh@1320 -- # shift 00:24:59.819 07:23:02 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:59.819 07:23:02 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:59.819 07:23:02 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:59.819 07:23:02 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:59.819 07:23:02 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:59.819 07:23:02 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:59.819 07:23:02 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:59.819 07:23:02 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.819 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:59.819 fio-3.35 00:24:59.819 Starting 1 thread 00:25:00.077 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.605 00:25:02.605 test: (groupid=0, jobs=1): err= 0: pid=1994335: Wed Oct 16 07:23:04 2024 00:25:02.605 read: IOPS=9768, BW=38.2MiB/s (40.0MB/s)(76.5MiB/2006msec) 00:25:02.605 slat (nsec): min=1873, max=158590, avg=2411.90, stdev=1940.95 00:25:02.605 clat (usec): min=2414, max=12366, avg=7211.42, stdev=536.00 00:25:02.605 lat (usec): min=2440, max=12368, avg=7213.83, stdev=535.90 00:25:02.605 clat percentiles (usec): 00:25:02.605 | 1.00th=[ 5932], 5.00th=[ 6390], 10.00th=[ 6587], 20.00th=[ 6783], 00:25:02.605 | 30.00th=[ 6980], 40.00th=[ 7111], 50.00th=[ 7242], 60.00th=[ 7308], 00:25:02.606 | 70.00th=[ 7504], 80.00th=[ 7635], 90.00th=[ 7832], 95.00th=[ 8029], 00:25:02.606 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[10552], 99.95th=[11731], 00:25:02.606 | 99.99th=[12387] 00:25:02.606 bw ( KiB/s): min=38016, max=39760, per=99.96%, avg=39058.00, stdev=751.78, samples=4 00:25:02.606 iops : min= 9504, max= 9940, avg=9764.50, stdev=187.95, samples=4 00:25:02.606 write: IOPS=9778, BW=38.2MiB/s (40.1MB/s)(76.6MiB/2006msec); 0 zone resets 00:25:02.606 slat (nsec): min=1952, max=138791, avg=2510.44, stdev=1382.64 00:25:02.606 clat (usec): min=1402, max=11759, avg=5822.58, stdev=471.82 00:25:02.606 lat (usec): min=1410, max=11761, avg=5825.09, stdev=471.76 00:25:02.606 clat percentiles (usec): 00:25:02.606 | 1.00th=[ 4817], 5.00th=[ 5145], 10.00th=[ 5276], 20.00th=[ 5473], 00:25:02.606 | 30.00th=[ 5604], 40.00th=[ 5735], 50.00th=[ 5800], 60.00th=[ 5932], 00:25:02.606 | 70.00th=[ 6063], 80.00th=[ 6194], 90.00th=[ 6325], 95.00th=[ 6521], 00:25:02.606 | 99.00th=[ 6849], 99.50th=[ 6915], 99.90th=[ 9634], 99.95th=[10945], 00:25:02.606 | 99.99th=[11731] 00:25:02.606 bw ( KiB/s): min=38576, max=39680, per=99.99%, avg=39110.00, stdev=451.48, samples=4 00:25:02.606 iops : min= 9644, max= 9920, avg=9777.50, stdev=112.87, samples=4 00:25:02.606 lat (msec) : 2=0.03%, 4=0.10%, 10=99.76%, 20=0.10% 00:25:02.606 cpu : usr=64.19%, sys=33.52%, ctx=83, majf=0, minf=41 00:25:02.606 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:02.606 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:02.606 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:02.606 issued rwts: total=19595,19616,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:02.606 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:02.606 00:25:02.606 Run status group 0 (all jobs): 00:25:02.606 READ: bw=38.2MiB/s (40.0MB/s), 38.2MiB/s-38.2MiB/s (40.0MB/s-40.0MB/s), io=76.5MiB (80.3MB), run=2006-2006msec 00:25:02.606 WRITE: bw=38.2MiB/s (40.1MB/s), 38.2MiB/s-38.2MiB/s (40.1MB/s-40.1MB/s), io=76.6MiB (80.3MB), run=2006-2006msec 00:25:02.606 07:23:05 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.606 07:23:05 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.606 07:23:05 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:25:02.606 07:23:05 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:02.606 07:23:05 -- common/autotest_common.sh@1318 -- # local sanitizers 00:25:02.606 07:23:05 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.606 07:23:05 -- common/autotest_common.sh@1320 -- # shift 00:25:02.606 07:23:05 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:25:02.606 07:23:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # grep libasan 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:02.606 07:23:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:02.606 07:23:05 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:02.606 07:23:05 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:02.606 07:23:05 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:02.606 07:23:05 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:02.606 07:23:05 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.606 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:02.606 fio-3.35 00:25:02.606 Starting 1 thread 00:25:02.606 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.132 00:25:05.132 test: (groupid=0, jobs=1): err= 0: pid=1994801: Wed Oct 16 07:23:07 2024 00:25:05.132 read: IOPS=8732, BW=136MiB/s (143MB/s)(274MiB/2009msec) 00:25:05.132 slat (usec): min=2, max=131, avg= 3.63, stdev= 1.98 00:25:05.132 clat (usec): min=2425, max=16412, avg=8521.71, stdev=2024.59 00:25:05.132 lat (usec): min=2429, max=16416, avg=8525.35, stdev=2024.61 00:25:05.132 clat percentiles (usec): 00:25:05.132 | 1.00th=[ 4424], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 6783], 00:25:05.132 | 30.00th=[ 7373], 40.00th=[ 7898], 50.00th=[ 8455], 60.00th=[ 9110], 00:25:05.132 | 70.00th=[ 9503], 80.00th=[10159], 90.00th=[10945], 95.00th=[11863], 00:25:05.132 | 99.00th=[14222], 99.50th=[15401], 99.90th=[16188], 99.95th=[16319], 00:25:05.132 | 99.99th=[16319] 00:25:05.132 bw ( KiB/s): min=59968, max=86304, per=51.75%, avg=72296.00, stdev=11970.86, samples=4 00:25:05.132 iops : min= 3748, max= 5394, avg=4518.50, stdev=748.18, samples=4 00:25:05.132 write: IOPS=5204, BW=81.3MiB/s (85.3MB/s)(147MiB/1812msec); 0 zone resets 00:25:05.132 slat (usec): min=30, max=138, avg=33.85, stdev= 5.61 00:25:05.133 clat (usec): min=4742, max=19057, avg=10719.71, stdev=1883.83 00:25:05.133 lat (usec): min=4774, max=19097, avg=10753.56, stdev=1883.71 00:25:05.133 clat percentiles (usec): 00:25:05.133 | 1.00th=[ 7111], 5.00th=[ 8029], 10.00th=[ 8586], 20.00th=[ 9110], 00:25:05.133 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10421], 60.00th=[10945], 00:25:05.133 | 70.00th=[11469], 80.00th=[12256], 90.00th=[13304], 95.00th=[14222], 00:25:05.133 | 99.00th=[15664], 99.50th=[16188], 99.90th=[18220], 99.95th=[18482], 00:25:05.133 | 99.99th=[19006] 00:25:05.133 bw ( KiB/s): min=63584, max=88864, per=90.11%, avg=75040.00, stdev=11804.83, samples=4 00:25:05.133 iops : min= 3974, max= 5554, avg=4690.00, stdev=737.80, samples=4 00:25:05.133 lat (msec) : 4=0.36%, 10=64.10%, 20=35.54% 00:25:05.133 cpu : usr=77.40%, sys=21.01%, ctx=30, majf=0, minf=75 00:25:05.133 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:25:05.133 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:05.133 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:05.133 issued rwts: total=17543,9431,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:05.133 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:05.133 00:25:05.133 Run status group 0 (all jobs): 00:25:05.133 READ: bw=136MiB/s (143MB/s), 136MiB/s-136MiB/s (143MB/s-143MB/s), io=274MiB (287MB), run=2009-2009msec 00:25:05.133 WRITE: bw=81.3MiB/s (85.3MB/s), 81.3MiB/s-81.3MiB/s (85.3MB/s-85.3MB/s), io=147MiB (155MB), run=1812-1812msec 00:25:05.133 07:23:07 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:05.133 07:23:07 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:05.133 07:23:07 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:05.133 07:23:07 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:05.133 07:23:07 -- common/autotest_common.sh@1498 -- # bdfs=() 00:25:05.133 07:23:07 -- common/autotest_common.sh@1498 -- # local bdfs 00:25:05.133 07:23:07 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:05.133 07:23:07 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:05.133 07:23:07 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:25:05.133 07:23:07 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:25:05.133 07:23:07 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:25:05.133 07:23:07 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:08.411 Nvme0n1 00:25:08.411 07:23:10 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:10.937 07:23:13 -- host/fio.sh@53 -- # ls_guid=8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d 00:25:10.937 07:23:13 -- host/fio.sh@54 -- # get_lvs_free_mb 8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d 00:25:10.937 07:23:13 -- common/autotest_common.sh@1343 -- # local lvs_uuid=8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d 00:25:10.937 07:23:13 -- common/autotest_common.sh@1344 -- # local lvs_info 00:25:10.937 07:23:13 -- common/autotest_common.sh@1345 -- # local fc 00:25:10.937 07:23:13 -- common/autotest_common.sh@1346 -- # local cs 00:25:10.937 07:23:13 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:11.195 07:23:14 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:25:11.195 { 00:25:11.195 "uuid": "8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d", 00:25:11.195 "name": "lvs_0", 00:25:11.195 "base_bdev": "Nvme0n1", 00:25:11.195 "total_data_clusters": 930, 00:25:11.195 "free_clusters": 930, 00:25:11.195 "block_size": 512, 00:25:11.195 "cluster_size": 1073741824 00:25:11.195 } 00:25:11.195 ]' 00:25:11.195 07:23:14 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d") .free_clusters' 00:25:11.453 07:23:14 -- common/autotest_common.sh@1348 -- # fc=930 00:25:11.453 07:23:14 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d") .cluster_size' 00:25:11.453 07:23:14 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:25:11.453 07:23:14 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:25:11.453 07:23:14 -- common/autotest_common.sh@1353 -- # echo 952320 00:25:11.453 952320 00:25:11.453 07:23:14 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:11.711 75fdc9df-fe76-4b83-894e-d3a0e07e5166 00:25:11.711 07:23:14 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:11.969 07:23:14 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:12.226 07:23:15 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:12.484 07:23:15 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:12.484 07:23:15 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:12.484 07:23:15 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:25:12.484 07:23:15 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:12.484 07:23:15 -- common/autotest_common.sh@1318 -- # local sanitizers 00:25:12.484 07:23:15 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.484 07:23:15 -- common/autotest_common.sh@1320 -- # shift 00:25:12.484 07:23:15 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:25:12.484 07:23:15 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # grep libasan 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:12.484 07:23:15 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:12.484 07:23:15 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:12.484 07:23:15 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:12.484 07:23:15 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:12.484 07:23:15 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:12.484 07:23:15 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:12.742 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:12.742 fio-3.35 00:25:12.742 Starting 1 thread 00:25:12.742 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.267 00:25:15.267 test: (groupid=0, jobs=1): err= 0: pid=1996121: Wed Oct 16 07:23:17 2024 00:25:15.267 read: IOPS=6393, BW=25.0MiB/s (26.2MB/s)(50.2MiB/2008msec) 00:25:15.267 slat (nsec): min=1921, max=127882, avg=2429.72, stdev=1685.76 00:25:15.267 clat (usec): min=1157, max=170654, avg=10966.07, stdev=11298.84 00:25:15.267 lat (usec): min=1160, max=170682, avg=10968.50, stdev=11299.04 00:25:15.267 clat percentiles (msec): 00:25:15.267 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:25:15.267 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:15.267 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:15.267 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:15.267 | 99.99th=[ 171] 00:25:15.267 bw ( KiB/s): min=18240, max=28160, per=99.88%, avg=25544.00, stdev=4871.76, samples=4 00:25:15.267 iops : min= 4560, max= 7040, avg=6386.00, stdev=1217.94, samples=4 00:25:15.267 write: IOPS=6395, BW=25.0MiB/s (26.2MB/s)(50.2MiB/2008msec); 0 zone resets 00:25:15.267 slat (nsec): min=1975, max=120998, avg=2491.58, stdev=1465.86 00:25:15.267 clat (usec): min=272, max=169109, avg=8922.17, stdev=10600.69 00:25:15.267 lat (usec): min=275, max=169114, avg=8924.66, stdev=10600.92 00:25:15.267 clat percentiles (msec): 00:25:15.267 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:25:15.267 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:15.267 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:15.267 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:15.267 | 99.99th=[ 169] 00:25:15.267 bw ( KiB/s): min=19240, max=27776, per=99.92%, avg=25562.00, stdev=4215.36, samples=4 00:25:15.267 iops : min= 4810, max= 6944, avg=6390.50, stdev=1053.84, samples=4 00:25:15.267 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:15.267 lat (msec) : 2=0.03%, 4=0.16%, 10=70.64%, 20=28.66%, 250=0.50% 00:25:15.267 cpu : usr=62.98%, sys=35.28%, ctx=116, majf=0, minf=41 00:25:15.267 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:15.267 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:15.267 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:15.267 issued rwts: total=12839,12842,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:15.267 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:15.267 00:25:15.267 Run status group 0 (all jobs): 00:25:15.267 READ: bw=25.0MiB/s (26.2MB/s), 25.0MiB/s-25.0MiB/s (26.2MB/s-26.2MB/s), io=50.2MiB (52.6MB), run=2008-2008msec 00:25:15.267 WRITE: bw=25.0MiB/s (26.2MB/s), 25.0MiB/s-25.0MiB/s (26.2MB/s-26.2MB/s), io=50.2MiB (52.6MB), run=2008-2008msec 00:25:15.267 07:23:18 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:15.525 07:23:18 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:16.458 07:23:19 -- host/fio.sh@64 -- # ls_nested_guid=26b9eef9-c346-45ab-a048-936e7053c249 00:25:16.458 07:23:19 -- host/fio.sh@65 -- # get_lvs_free_mb 26b9eef9-c346-45ab-a048-936e7053c249 00:25:16.458 07:23:19 -- common/autotest_common.sh@1343 -- # local lvs_uuid=26b9eef9-c346-45ab-a048-936e7053c249 00:25:16.458 07:23:19 -- common/autotest_common.sh@1344 -- # local lvs_info 00:25:16.458 07:23:19 -- common/autotest_common.sh@1345 -- # local fc 00:25:16.458 07:23:19 -- common/autotest_common.sh@1346 -- # local cs 00:25:16.458 07:23:19 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:16.745 07:23:19 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:25:16.745 { 00:25:16.745 "uuid": "8ff5dc08-4e4f-42dc-99d1-b5fbe3b14c1d", 00:25:16.745 "name": "lvs_0", 00:25:16.745 "base_bdev": "Nvme0n1", 00:25:16.745 "total_data_clusters": 930, 00:25:16.745 "free_clusters": 0, 00:25:16.745 "block_size": 512, 00:25:16.745 "cluster_size": 1073741824 00:25:16.745 }, 00:25:16.745 { 00:25:16.745 "uuid": "26b9eef9-c346-45ab-a048-936e7053c249", 00:25:16.745 "name": "lvs_n_0", 00:25:16.745 "base_bdev": "75fdc9df-fe76-4b83-894e-d3a0e07e5166", 00:25:16.745 "total_data_clusters": 237847, 00:25:16.745 "free_clusters": 237847, 00:25:16.745 "block_size": 512, 00:25:16.745 "cluster_size": 4194304 00:25:16.745 } 00:25:16.745 ]' 00:25:16.745 07:23:19 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="26b9eef9-c346-45ab-a048-936e7053c249") .free_clusters' 00:25:17.025 07:23:19 -- common/autotest_common.sh@1348 -- # fc=237847 00:25:17.025 07:23:19 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="26b9eef9-c346-45ab-a048-936e7053c249") .cluster_size' 00:25:17.026 07:23:19 -- common/autotest_common.sh@1349 -- # cs=4194304 00:25:17.026 07:23:19 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:25:17.026 07:23:19 -- common/autotest_common.sh@1353 -- # echo 951388 00:25:17.026 951388 00:25:17.026 07:23:19 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:17.590 77140ca9-ac05-41c7-8a27-6c32df30b461 00:25:17.590 07:23:20 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:17.848 07:23:20 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:18.106 07:23:20 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:18.364 07:23:21 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.364 07:23:21 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.364 07:23:21 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:25:18.364 07:23:21 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:18.364 07:23:21 -- common/autotest_common.sh@1318 -- # local sanitizers 00:25:18.364 07:23:21 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.364 07:23:21 -- common/autotest_common.sh@1320 -- # shift 00:25:18.364 07:23:21 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:25:18.364 07:23:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # grep libasan 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:18.364 07:23:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:18.364 07:23:21 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:25:18.364 07:23:21 -- common/autotest_common.sh@1324 -- # asan_lib= 00:25:18.364 07:23:21 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:25:18.364 07:23:21 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:18.364 07:23:21 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.622 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:18.622 fio-3.35 00:25:18.622 Starting 1 thread 00:25:18.622 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.149 00:25:21.149 test: (groupid=0, jobs=1): err= 0: pid=1996882: Wed Oct 16 07:23:23 2024 00:25:21.149 read: IOPS=6164, BW=24.1MiB/s (25.2MB/s)(48.4MiB/2009msec) 00:25:21.149 slat (usec): min=2, max=168, avg= 2.70, stdev= 2.41 00:25:21.149 clat (usec): min=4325, max=19229, avg=11399.64, stdev=965.68 00:25:21.149 lat (usec): min=4342, max=19231, avg=11402.34, stdev=965.60 00:25:21.149 clat percentiles (usec): 00:25:21.149 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:25:21.149 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:25:21.149 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12911], 00:25:21.149 | 99.00th=[13566], 99.50th=[13829], 99.90th=[16909], 99.95th=[19006], 00:25:21.149 | 99.99th=[19268] 00:25:21.149 bw ( KiB/s): min=23256, max=25392, per=99.91%, avg=24634.00, stdev=944.08, samples=4 00:25:21.149 iops : min= 5814, max= 6348, avg=6158.50, stdev=236.02, samples=4 00:25:21.149 write: IOPS=6151, BW=24.0MiB/s (25.2MB/s)(48.3MiB/2009msec); 0 zone resets 00:25:21.149 slat (usec): min=2, max=138, avg= 2.75, stdev= 1.85 00:25:21.149 clat (usec): min=2135, max=16773, avg=9191.37, stdev=839.48 00:25:21.149 lat (usec): min=2141, max=16775, avg=9194.11, stdev=839.47 00:25:21.149 clat percentiles (usec): 00:25:21.149 | 1.00th=[ 7308], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:21.149 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:25:21.149 | 70.00th=[ 9634], 80.00th=[ 9765], 90.00th=[10159], 95.00th=[10421], 00:25:21.149 | 99.00th=[11076], 99.50th=[11338], 99.90th=[15533], 99.95th=[16581], 00:25:21.149 | 99.99th=[16712] 00:25:21.149 bw ( KiB/s): min=24280, max=24816, per=99.96%, avg=24598.00, stdev=226.40, samples=4 00:25:21.149 iops : min= 6070, max= 6204, avg=6149.50, stdev=56.60, samples=4 00:25:21.149 lat (msec) : 4=0.04%, 10=45.75%, 20=54.21% 00:25:21.149 cpu : usr=63.05%, sys=35.06%, ctx=99, majf=0, minf=41 00:25:21.149 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:21.149 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:21.149 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:21.149 issued rwts: total=12384,12359,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:21.149 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:21.149 00:25:21.149 Run status group 0 (all jobs): 00:25:21.149 READ: bw=24.1MiB/s (25.2MB/s), 24.1MiB/s-24.1MiB/s (25.2MB/s-25.2MB/s), io=48.4MiB (50.7MB), run=2009-2009msec 00:25:21.149 WRITE: bw=24.0MiB/s (25.2MB/s), 24.0MiB/s-24.0MiB/s (25.2MB/s-25.2MB/s), io=48.3MiB (50.6MB), run=2009-2009msec 00:25:21.149 07:23:23 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:21.149 07:23:23 -- host/fio.sh@74 -- # sync 00:25:21.149 07:23:23 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:25.329 07:23:27 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:25.329 07:23:28 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:28.609 07:23:30 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:28.609 07:23:31 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:30.507 07:23:33 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:30.507 07:23:33 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:30.507 07:23:33 -- host/fio.sh@86 -- # nvmftestfini 00:25:30.507 07:23:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:30.507 07:23:33 -- nvmf/common.sh@116 -- # sync 00:25:30.507 07:23:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:30.507 07:23:33 -- nvmf/common.sh@119 -- # set +e 00:25:30.507 07:23:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:30.507 07:23:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:30.507 rmmod nvme_tcp 00:25:30.507 rmmod nvme_fabrics 00:25:30.507 rmmod nvme_keyring 00:25:30.507 07:23:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:30.507 07:23:33 -- nvmf/common.sh@123 -- # set -e 00:25:30.507 07:23:33 -- nvmf/common.sh@124 -- # return 0 00:25:30.507 07:23:33 -- nvmf/common.sh@477 -- # '[' -n 1993955 ']' 00:25:30.507 07:23:33 -- nvmf/common.sh@478 -- # killprocess 1993955 00:25:30.507 07:23:33 -- common/autotest_common.sh@926 -- # '[' -z 1993955 ']' 00:25:30.507 07:23:33 -- common/autotest_common.sh@930 -- # kill -0 1993955 00:25:30.507 07:23:33 -- common/autotest_common.sh@931 -- # uname 00:25:30.507 07:23:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:30.507 07:23:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1993955 00:25:30.507 07:23:33 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:30.507 07:23:33 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:30.507 07:23:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1993955' 00:25:30.507 killing process with pid 1993955 00:25:30.507 07:23:33 -- common/autotest_common.sh@945 -- # kill 1993955 00:25:30.507 07:23:33 -- common/autotest_common.sh@950 -- # wait 1993955 00:25:30.766 07:23:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:30.766 07:23:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:30.766 07:23:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:30.766 07:23:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:30.766 07:23:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:30.766 07:23:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.766 07:23:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.766 07:23:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.668 07:23:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.668 00:25:32.668 real 0m37.846s 00:25:32.668 user 2m25.512s 00:25:32.668 sys 0m6.774s 00:25:32.668 07:23:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:32.668 07:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.668 ************************************ 00:25:32.668 END TEST nvmf_fio_host 00:25:32.668 ************************************ 00:25:32.926 07:23:35 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:32.926 07:23:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:32.926 07:23:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:32.927 07:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:32.927 ************************************ 00:25:32.927 START TEST nvmf_failover 00:25:32.927 ************************************ 00:25:32.927 07:23:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:32.927 * Looking for test storage... 00:25:32.927 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:32.927 07:23:35 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:32.927 07:23:35 -- nvmf/common.sh@7 -- # uname -s 00:25:32.927 07:23:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:32.927 07:23:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:32.927 07:23:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:32.927 07:23:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:32.927 07:23:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:32.927 07:23:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:32.927 07:23:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:32.927 07:23:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:32.927 07:23:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:32.927 07:23:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:32.927 07:23:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.927 07:23:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:32.927 07:23:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:32.927 07:23:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:32.927 07:23:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:32.927 07:23:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:32.927 07:23:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:32.927 07:23:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:32.927 07:23:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:32.927 07:23:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.927 07:23:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.927 07:23:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.927 07:23:35 -- paths/export.sh@5 -- # export PATH 00:25:32.927 07:23:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:32.927 07:23:35 -- nvmf/common.sh@46 -- # : 0 00:25:32.927 07:23:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:32.927 07:23:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:32.927 07:23:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:32.927 07:23:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:32.927 07:23:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:32.927 07:23:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:32.927 07:23:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:32.927 07:23:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:32.927 07:23:35 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:32.927 07:23:35 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:32.927 07:23:35 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:32.927 07:23:35 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:32.927 07:23:35 -- host/failover.sh@18 -- # nvmftestinit 00:25:32.927 07:23:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:32.927 07:23:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:32.927 07:23:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:32.927 07:23:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:32.927 07:23:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:32.927 07:23:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.927 07:23:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.927 07:23:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.927 07:23:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:32.927 07:23:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:32.927 07:23:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:32.927 07:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:34.828 07:23:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:34.828 07:23:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:34.828 07:23:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:34.828 07:23:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:34.828 07:23:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:34.828 07:23:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:34.828 07:23:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:34.828 07:23:37 -- nvmf/common.sh@294 -- # net_devs=() 00:25:34.828 07:23:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:34.828 07:23:37 -- nvmf/common.sh@295 -- # e810=() 00:25:34.828 07:23:37 -- nvmf/common.sh@295 -- # local -ga e810 00:25:34.828 07:23:37 -- nvmf/common.sh@296 -- # x722=() 00:25:34.828 07:23:37 -- nvmf/common.sh@296 -- # local -ga x722 00:25:34.828 07:23:37 -- nvmf/common.sh@297 -- # mlx=() 00:25:34.828 07:23:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:34.828 07:23:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:34.828 07:23:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:34.828 07:23:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:34.828 07:23:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:34.828 07:23:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.828 07:23:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:34.828 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:34.828 07:23:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:34.828 07:23:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:34.828 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:34.828 07:23:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:34.828 07:23:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:34.828 07:23:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.828 07:23:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.828 07:23:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.828 07:23:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.828 07:23:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:34.828 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:34.828 07:23:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.828 07:23:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:34.828 07:23:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.828 07:23:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:34.828 07:23:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.829 07:23:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:34.829 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:34.829 07:23:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.829 07:23:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:34.829 07:23:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:34.829 07:23:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:34.829 07:23:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:34.829 07:23:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:34.829 07:23:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:34.829 07:23:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:34.829 07:23:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:34.829 07:23:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:34.829 07:23:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:34.829 07:23:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:34.829 07:23:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:34.829 07:23:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:34.829 07:23:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:34.829 07:23:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:34.829 07:23:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:34.829 07:23:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:34.829 07:23:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:35.087 07:23:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:35.087 07:23:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:35.087 07:23:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:35.087 07:23:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:35.087 07:23:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:35.087 07:23:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:35.087 07:23:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:35.087 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:35.087 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:25:35.087 00:25:35.087 --- 10.0.0.2 ping statistics --- 00:25:35.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:35.087 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:25:35.087 07:23:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:35.087 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:35.087 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:25:35.087 00:25:35.087 --- 10.0.0.1 ping statistics --- 00:25:35.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:35.087 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:25:35.087 07:23:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:35.087 07:23:37 -- nvmf/common.sh@410 -- # return 0 00:25:35.087 07:23:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:35.087 07:23:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:35.087 07:23:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:35.087 07:23:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:35.087 07:23:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:35.087 07:23:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:35.087 07:23:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:35.087 07:23:37 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:35.087 07:23:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:35.087 07:23:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:35.087 07:23:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.087 07:23:37 -- nvmf/common.sh@469 -- # nvmfpid=2000179 00:25:35.087 07:23:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:35.087 07:23:37 -- nvmf/common.sh@470 -- # waitforlisten 2000179 00:25:35.087 07:23:37 -- common/autotest_common.sh@819 -- # '[' -z 2000179 ']' 00:25:35.087 07:23:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:35.087 07:23:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:35.087 07:23:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:35.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:35.087 07:23:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:35.087 07:23:37 -- common/autotest_common.sh@10 -- # set +x 00:25:35.087 [2024-10-16 07:23:37.936983] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:35.087 [2024-10-16 07:23:37.937075] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:35.087 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.087 [2024-10-16 07:23:38.015203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:35.346 [2024-10-16 07:23:38.134513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:35.346 [2024-10-16 07:23:38.134674] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:35.346 [2024-10-16 07:23:38.134693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:35.346 [2024-10-16 07:23:38.134708] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:35.346 [2024-10-16 07:23:38.134828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:35.346 [2024-10-16 07:23:38.134854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:35.346 [2024-10-16 07:23:38.134858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:36.278 07:23:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:36.278 07:23:38 -- common/autotest_common.sh@852 -- # return 0 00:25:36.279 07:23:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:36.279 07:23:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:36.279 07:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:36.279 07:23:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:36.279 07:23:38 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:36.279 [2024-10-16 07:23:39.199608] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:36.279 07:23:39 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:36.537 Malloc0 00:25:36.794 07:23:39 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:37.052 07:23:39 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:37.052 07:23:39 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:37.310 [2024-10-16 07:23:40.232144] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.310 07:23:40 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:37.568 [2024-10-16 07:23:40.500899] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:37.827 07:23:40 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:38.085 [2024-10-16 07:23:40.773972] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:38.085 07:23:40 -- host/failover.sh@31 -- # bdevperf_pid=2000606 00:25:38.085 07:23:40 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:38.085 07:23:40 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.085 07:23:40 -- host/failover.sh@34 -- # waitforlisten 2000606 /var/tmp/bdevperf.sock 00:25:38.085 07:23:40 -- common/autotest_common.sh@819 -- # '[' -z 2000606 ']' 00:25:38.085 07:23:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:38.085 07:23:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:38.085 07:23:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:38.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:38.085 07:23:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:38.085 07:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:39.018 07:23:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:39.018 07:23:41 -- common/autotest_common.sh@852 -- # return 0 00:25:39.018 07:23:41 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:39.276 NVMe0n1 00:25:39.276 07:23:42 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:39.841 00:25:39.841 07:23:42 -- host/failover.sh@39 -- # run_test_pid=2000753 00:25:39.841 07:23:42 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:39.841 07:23:42 -- host/failover.sh@41 -- # sleep 1 00:25:40.774 07:23:43 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:41.033 [2024-10-16 07:23:43.771441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771571] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771709] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771734] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771784] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771817] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771862] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 [2024-10-16 07:23:43.771874] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1412cb0 is same with the state(5) to be set 00:25:41.033 07:23:43 -- host/failover.sh@45 -- # sleep 3 00:25:44.315 07:23:46 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:44.315 00:25:44.315 07:23:47 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:44.572 [2024-10-16 07:23:47.406701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406959] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.406994] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407057] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407080] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407103] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407192] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 [2024-10-16 07:23:47.407204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14143a0 is same with the state(5) to be set 00:25:44.572 07:23:47 -- host/failover.sh@50 -- # sleep 3 00:25:47.850 07:23:50 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:47.850 [2024-10-16 07:23:50.724394] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:47.850 07:23:50 -- host/failover.sh@55 -- # sleep 1 00:25:49.224 07:23:51 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:49.224 [2024-10-16 07:23:52.033483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033612] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033624] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033702] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033786] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033810] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.224 [2024-10-16 07:23:52.033834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033857] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033915] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033949] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.033995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034017] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034057] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034092] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034103] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034137] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034171] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034208] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034220] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034277] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034299] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 [2024-10-16 07:23:52.034333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1414a80 is same with the state(5) to be set 00:25:49.225 07:23:52 -- host/failover.sh@59 -- # wait 2000753 00:25:55.794 0 00:25:55.794 07:23:57 -- host/failover.sh@61 -- # killprocess 2000606 00:25:55.794 07:23:57 -- common/autotest_common.sh@926 -- # '[' -z 2000606 ']' 00:25:55.794 07:23:57 -- common/autotest_common.sh@930 -- # kill -0 2000606 00:25:55.794 07:23:57 -- common/autotest_common.sh@931 -- # uname 00:25:55.794 07:23:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:55.794 07:23:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2000606 00:25:55.794 07:23:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:55.794 07:23:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:55.794 07:23:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2000606' 00:25:55.794 killing process with pid 2000606 00:25:55.794 07:23:57 -- common/autotest_common.sh@945 -- # kill 2000606 00:25:55.794 07:23:57 -- common/autotest_common.sh@950 -- # wait 2000606 00:25:55.794 07:23:57 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:55.794 [2024-10-16 07:23:40.824497] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:55.794 [2024-10-16 07:23:40.824582] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000606 ] 00:25:55.794 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.794 [2024-10-16 07:23:40.884673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.794 [2024-10-16 07:23:40.993724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:55.794 Running I/O for 15 seconds... 00:25:55.794 [2024-10-16 07:23:43.772146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.794 [2024-10-16 07:23:43.772420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.794 [2024-10-16 07:23:43.772435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.772840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.772869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.772898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.772975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.772988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:118168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:118192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.795 [2024-10-16 07:23:43.773622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.795 [2024-10-16 07:23:43.773655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.795 [2024-10-16 07:23:43.773671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.773684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:118256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:118272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.773866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:118288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.773923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:118304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:118312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.773979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.773994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:118328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:118400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:118408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:118416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:118424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:118432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:118440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:118448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:118456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:118504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:118520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:118552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.796 [2024-10-16 07:23:43.774895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.796 [2024-10-16 07:23:43.774910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.796 [2024-10-16 07:23:43.774923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.774938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:118568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.774952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.774967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.774981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.774996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:118584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.775010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:118624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.775158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:118632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.775192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:118640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.775221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:117816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:117856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:117872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:117880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:118648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.797 [2024-10-16 07:23:43.775707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.797 [2024-10-16 07:23:43.775978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.775992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ebc6a0 is same with the state(5) to be set 00:25:55.797 [2024-10-16 07:23:43.776009] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:55.797 [2024-10-16 07:23:43.776028] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:55.797 [2024-10-16 07:23:43.776040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118088 len:8 PRP1 0x0 PRP2 0x0 00:25:55.797 [2024-10-16 07:23:43.776052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.776112] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ebc6a0 was disconnected and freed. reset controller. 00:25:55.797 [2024-10-16 07:23:43.776138] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:55.797 [2024-10-16 07:23:43.776174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.797 [2024-10-16 07:23:43.776193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.797 [2024-10-16 07:23:43.776208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.797 [2024-10-16 07:23:43.776221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:43.776234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.798 [2024-10-16 07:23:43.776247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:43.776260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.798 [2024-10-16 07:23:43.776274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:43.776287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:55.798 [2024-10-16 07:23:43.778582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:55.798 [2024-10-16 07:23:43.778620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e9d870 (9): Bad file descriptor 00:25:55.798 [2024-10-16 07:23:43.804894] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.798 [2024-10-16 07:23:47.407387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:93800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:93816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:93824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:93832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:93848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:93216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:93224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:93232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:93280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:93312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:93368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:93392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:93416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:93864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:93904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.407908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:93912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.407936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:93920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.407981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:93928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.407995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:93936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.408024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:93944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.408067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:93952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.408094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:93960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:93968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:93976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.408177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:93984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.798 [2024-10-16 07:23:47.408205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:93448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:93504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:93536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:93560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:93584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:93624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.798 [2024-10-16 07:23:47.408382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.798 [2024-10-16 07:23:47.408396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:93640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:93992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:94000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:94008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:94016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:94024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:94032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:94040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:94048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:94056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:94064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:94072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:94080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:94088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:94096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:94104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:94112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.408883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:94120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:94128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:94136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.408970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.408984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:94144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:94152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:94160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:94168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:94176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:94184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:94192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:94200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:94208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:94216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:94224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:94232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:94240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:94248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:94256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:94264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:94272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:94280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:94288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:94296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:94304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.799 [2024-10-16 07:23:47.409580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.799 [2024-10-16 07:23:47.409595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:94312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.799 [2024-10-16 07:23:47.409608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:94320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:94328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:94336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:94344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:94352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:94360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:94368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:94376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.409871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:94384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:94392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:94400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:94408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.409982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.409997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:94416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:94424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:94432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:94440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:94448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:94456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:94464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:94472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:94480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:94488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:94496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:94504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:94512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:94520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:94528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:94536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:94544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:93648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:93672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:93704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:93712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:93728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:93736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:93752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:93784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:94552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:94560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:94568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:94576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.800 [2024-10-16 07:23:47.410851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:94584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.800 [2024-10-16 07:23:47.410884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.800 [2024-10-16 07:23:47.410900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:94592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.410914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.410929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:94600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.801 [2024-10-16 07:23:47.410943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.410958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:94608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.410972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.410987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:94616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.801 [2024-10-16 07:23:47.411001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:94624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.801 [2024-10-16 07:23:47.411029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:93792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:93808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:93840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:93856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:93872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:93880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:93888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:47.411237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ec9c90 is same with the state(5) to be set 00:25:55.801 [2024-10-16 07:23:47.411273] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:55.801 [2024-10-16 07:23:47.411284] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:55.801 [2024-10-16 07:23:47.411296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:93896 len:8 PRP1 0x0 PRP2 0x0 00:25:55.801 [2024-10-16 07:23:47.411309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411370] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ec9c90 was disconnected and freed. reset controller. 00:25:55.801 [2024-10-16 07:23:47.411389] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:55.801 [2024-10-16 07:23:47.411422] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.801 [2024-10-16 07:23:47.411440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411455] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.801 [2024-10-16 07:23:47.411468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.801 [2024-10-16 07:23:47.411494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.801 [2024-10-16 07:23:47.411520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:47.411533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:55.801 [2024-10-16 07:23:47.411571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e9d870 (9): Bad file descriptor 00:25:55.801 [2024-10-16 07:23:47.413675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:55.801 [2024-10-16 07:23:47.523272] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.801 [2024-10-16 07:23:52.034461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:68552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:68560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:68584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:68600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:67880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:67904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:67912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:67920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:67944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:67952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:67968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:68016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:68608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:68632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:68640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.034975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.034990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:68024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:68040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:68056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:68072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:68096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:68104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.801 [2024-10-16 07:23:52.035171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.801 [2024-10-16 07:23:52.035186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:68112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:68120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:68656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:68664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:68720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:68128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:68136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:68184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:68200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:68224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:68232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:68240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:68248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:68728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:68736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:68752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:68760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:68776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.035680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:68784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:68792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:68800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:68808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.035821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:68816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:68824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.035877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:68256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:68272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:68280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.035985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:68288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.035999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:68312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:68344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:68360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:68384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:68832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:68840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:68848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:68856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:68864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:68872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:68880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:68888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:68896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:68904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.802 [2024-10-16 07:23:52.036398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.802 [2024-10-16 07:23:52.036413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:68912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.802 [2024-10-16 07:23:52.036425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:68920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:68928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.036480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:68936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.036508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:68952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.036567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:68392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:68448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:68464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:68480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:68504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:68512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:68520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:68528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:68960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:68968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.036873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:68976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:68984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:68992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.036964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.036979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:69000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.036993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:69008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:69016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:69024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:69032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:69040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:69048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:69056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:69064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:69072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:69080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.803 [2024-10-16 07:23:52.037306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:69088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:68536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:68544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:68568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:68576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:68592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:68616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:68624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.803 [2024-10-16 07:23:52.037551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:68648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.803 [2024-10-16 07:23:52.037564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:69096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:69104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:69112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:69120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.037683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:69128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:69136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:69144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.037781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:69152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:69160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:69168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.037866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:69176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:69184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:69192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.037959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.037974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:69200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.037988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:69208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.038017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:69216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:69224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.804 [2024-10-16 07:23:52.038079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:69232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:68672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:68680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:68688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:68696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:68704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:68712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:68744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:55.804 [2024-10-16 07:23:52.038304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ea9d10 is same with the state(5) to be set 00:25:55.804 [2024-10-16 07:23:52.038336] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:55.804 [2024-10-16 07:23:52.038347] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:55.804 [2024-10-16 07:23:52.038364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:68768 len:8 PRP1 0x0 PRP2 0x0 00:25:55.804 [2024-10-16 07:23:52.038377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038447] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ea9d10 was disconnected and freed. reset controller. 00:25:55.804 [2024-10-16 07:23:52.038465] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:55.804 [2024-10-16 07:23:52.038500] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.804 [2024-10-16 07:23:52.038523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.804 [2024-10-16 07:23:52.038551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038565] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.804 [2024-10-16 07:23:52.038577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.804 [2024-10-16 07:23:52.038603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.804 [2024-10-16 07:23:52.038617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:55.804 [2024-10-16 07:23:52.038670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e9d870 (9): Bad file descriptor 00:25:55.804 [2024-10-16 07:23:52.040633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:55.804 [2024-10-16 07:23:52.071657] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.804 00:25:55.804 Latency(us) 00:25:55.804 [2024-10-16T05:23:58.744Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.804 [2024-10-16T05:23:58.744Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:55.804 Verification LBA range: start 0x0 length 0x4000 00:25:55.804 NVMe0n1 : 15.01 12454.26 48.65 645.37 0.00 9754.35 606.81 15437.37 00:25:55.804 [2024-10-16T05:23:58.744Z] =================================================================================================================== 00:25:55.804 [2024-10-16T05:23:58.744Z] Total : 12454.26 48.65 645.37 0.00 9754.35 606.81 15437.37 00:25:55.804 Received shutdown signal, test time was about 15.000000 seconds 00:25:55.804 00:25:55.804 Latency(us) 00:25:55.804 [2024-10-16T05:23:58.744Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.804 [2024-10-16T05:23:58.744Z] =================================================================================================================== 00:25:55.804 [2024-10-16T05:23:58.744Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:55.804 07:23:57 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:55.804 07:23:57 -- host/failover.sh@65 -- # count=3 00:25:55.804 07:23:57 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:55.804 07:23:57 -- host/failover.sh@73 -- # bdevperf_pid=2002653 00:25:55.804 07:23:57 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:55.804 07:23:57 -- host/failover.sh@75 -- # waitforlisten 2002653 /var/tmp/bdevperf.sock 00:25:55.804 07:23:57 -- common/autotest_common.sh@819 -- # '[' -z 2002653 ']' 00:25:55.804 07:23:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:55.804 07:23:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:55.804 07:23:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:55.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:55.805 07:23:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:55.805 07:23:57 -- common/autotest_common.sh@10 -- # set +x 00:25:56.062 07:23:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:56.062 07:23:58 -- common/autotest_common.sh@852 -- # return 0 00:25:56.062 07:23:58 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:56.320 [2024-10-16 07:23:59.197128] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:56.320 07:23:59 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:56.578 [2024-10-16 07:23:59.449862] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:56.578 07:23:59 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:57.144 NVMe0n1 00:25:57.144 07:23:59 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:57.709 00:25:57.709 07:24:00 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:57.967 00:25:57.967 07:24:00 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:57.967 07:24:00 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:58.237 07:24:01 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:58.558 07:24:01 -- host/failover.sh@87 -- # sleep 3 00:26:01.862 07:24:04 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:01.862 07:24:04 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:01.862 07:24:04 -- host/failover.sh@90 -- # run_test_pid=2003593 00:26:01.862 07:24:04 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:01.862 07:24:04 -- host/failover.sh@92 -- # wait 2003593 00:26:03.235 0 00:26:03.235 07:24:05 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:03.235 [2024-10-16 07:23:58.004553] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:03.235 [2024-10-16 07:23:58.004645] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2002653 ] 00:26:03.235 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.235 [2024-10-16 07:23:58.064241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.235 [2024-10-16 07:23:58.169515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:03.235 [2024-10-16 07:24:01.378021] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:03.235 [2024-10-16 07:24:01.378120] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.235 [2024-10-16 07:24:01.378144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.235 [2024-10-16 07:24:01.378161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.235 [2024-10-16 07:24:01.378174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.235 [2024-10-16 07:24:01.378188] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.235 [2024-10-16 07:24:01.378216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.235 [2024-10-16 07:24:01.378231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.235 [2024-10-16 07:24:01.378245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.235 [2024-10-16 07:24:01.378259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.235 [2024-10-16 07:24:01.378301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.235 [2024-10-16 07:24:01.378334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbe7870 (9): Bad file descriptor 00:26:03.235 [2024-10-16 07:24:01.385105] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:03.235 Running I/O for 1 seconds... 00:26:03.235 00:26:03.235 Latency(us) 00:26:03.235 [2024-10-16T05:24:06.175Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.235 [2024-10-16T05:24:06.175Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:03.235 Verification LBA range: start 0x0 length 0x4000 00:26:03.235 NVMe0n1 : 1.01 12433.20 48.57 0.00 0.00 10243.91 1868.99 11262.48 00:26:03.235 [2024-10-16T05:24:06.175Z] =================================================================================================================== 00:26:03.235 [2024-10-16T05:24:06.175Z] Total : 12433.20 48.57 0.00 0.00 10243.91 1868.99 11262.48 00:26:03.235 07:24:05 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.235 07:24:05 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:03.235 07:24:06 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.493 07:24:06 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.493 07:24:06 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:03.751 07:24:06 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.009 07:24:06 -- host/failover.sh@101 -- # sleep 3 00:26:07.287 07:24:09 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.287 07:24:09 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:07.287 07:24:10 -- host/failover.sh@108 -- # killprocess 2002653 00:26:07.287 07:24:10 -- common/autotest_common.sh@926 -- # '[' -z 2002653 ']' 00:26:07.287 07:24:10 -- common/autotest_common.sh@930 -- # kill -0 2002653 00:26:07.287 07:24:10 -- common/autotest_common.sh@931 -- # uname 00:26:07.287 07:24:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:07.287 07:24:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2002653 00:26:07.545 07:24:10 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:07.545 07:24:10 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:07.545 07:24:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2002653' 00:26:07.545 killing process with pid 2002653 00:26:07.545 07:24:10 -- common/autotest_common.sh@945 -- # kill 2002653 00:26:07.545 07:24:10 -- common/autotest_common.sh@950 -- # wait 2002653 00:26:07.545 07:24:10 -- host/failover.sh@110 -- # sync 00:26:07.545 07:24:10 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:07.802 07:24:10 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:07.802 07:24:10 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:07.802 07:24:10 -- host/failover.sh@116 -- # nvmftestfini 00:26:07.802 07:24:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:07.802 07:24:10 -- nvmf/common.sh@116 -- # sync 00:26:07.802 07:24:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:07.802 07:24:10 -- nvmf/common.sh@119 -- # set +e 00:26:07.802 07:24:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:07.802 07:24:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:08.060 rmmod nvme_tcp 00:26:08.060 rmmod nvme_fabrics 00:26:08.060 rmmod nvme_keyring 00:26:08.060 07:24:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:08.060 07:24:10 -- nvmf/common.sh@123 -- # set -e 00:26:08.060 07:24:10 -- nvmf/common.sh@124 -- # return 0 00:26:08.060 07:24:10 -- nvmf/common.sh@477 -- # '[' -n 2000179 ']' 00:26:08.060 07:24:10 -- nvmf/common.sh@478 -- # killprocess 2000179 00:26:08.060 07:24:10 -- common/autotest_common.sh@926 -- # '[' -z 2000179 ']' 00:26:08.060 07:24:10 -- common/autotest_common.sh@930 -- # kill -0 2000179 00:26:08.060 07:24:10 -- common/autotest_common.sh@931 -- # uname 00:26:08.060 07:24:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:08.060 07:24:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2000179 00:26:08.060 07:24:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:08.060 07:24:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:08.060 07:24:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2000179' 00:26:08.060 killing process with pid 2000179 00:26:08.060 07:24:10 -- common/autotest_common.sh@945 -- # kill 2000179 00:26:08.060 07:24:10 -- common/autotest_common.sh@950 -- # wait 2000179 00:26:08.318 07:24:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:08.318 07:24:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:08.318 07:24:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:08.318 07:24:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:08.318 07:24:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:08.318 07:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.318 07:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.318 07:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.848 07:24:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.848 00:26:10.848 real 0m37.568s 00:26:10.848 user 2m13.492s 00:26:10.848 sys 0m5.930s 00:26:10.848 07:24:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:10.848 07:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.848 ************************************ 00:26:10.848 END TEST nvmf_failover 00:26:10.848 ************************************ 00:26:10.848 07:24:13 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:10.848 07:24:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:10.848 07:24:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:10.848 07:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:10.848 ************************************ 00:26:10.848 START TEST nvmf_discovery 00:26:10.848 ************************************ 00:26:10.848 07:24:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:10.848 * Looking for test storage... 00:26:10.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:10.848 07:24:13 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:10.848 07:24:13 -- nvmf/common.sh@7 -- # uname -s 00:26:10.848 07:24:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:10.848 07:24:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:10.848 07:24:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:10.848 07:24:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:10.848 07:24:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:10.848 07:24:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:10.848 07:24:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:10.848 07:24:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:10.848 07:24:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:10.848 07:24:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:10.848 07:24:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.848 07:24:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.848 07:24:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:10.848 07:24:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:10.848 07:24:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:10.848 07:24:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:10.848 07:24:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:10.848 07:24:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:10.848 07:24:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:10.848 07:24:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.848 07:24:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.848 07:24:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.848 07:24:13 -- paths/export.sh@5 -- # export PATH 00:26:10.849 07:24:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.849 07:24:13 -- nvmf/common.sh@46 -- # : 0 00:26:10.849 07:24:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:10.849 07:24:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:10.849 07:24:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:10.849 07:24:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:10.849 07:24:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:10.849 07:24:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:10.849 07:24:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:10.849 07:24:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:10.849 07:24:13 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:10.849 07:24:13 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:10.849 07:24:13 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:10.849 07:24:13 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:10.849 07:24:13 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:10.849 07:24:13 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:10.849 07:24:13 -- host/discovery.sh@25 -- # nvmftestinit 00:26:10.849 07:24:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:10.849 07:24:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:10.849 07:24:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:10.849 07:24:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:10.849 07:24:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:10.849 07:24:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:10.849 07:24:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:10.849 07:24:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.849 07:24:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:10.849 07:24:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:10.849 07:24:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:10.849 07:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:12.749 07:24:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:12.749 07:24:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:12.750 07:24:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:12.750 07:24:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:12.750 07:24:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:12.750 07:24:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:12.750 07:24:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:12.750 07:24:15 -- nvmf/common.sh@294 -- # net_devs=() 00:26:12.750 07:24:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:12.750 07:24:15 -- nvmf/common.sh@295 -- # e810=() 00:26:12.750 07:24:15 -- nvmf/common.sh@295 -- # local -ga e810 00:26:12.750 07:24:15 -- nvmf/common.sh@296 -- # x722=() 00:26:12.750 07:24:15 -- nvmf/common.sh@296 -- # local -ga x722 00:26:12.750 07:24:15 -- nvmf/common.sh@297 -- # mlx=() 00:26:12.750 07:24:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:12.750 07:24:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:12.750 07:24:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.750 07:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:12.750 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:12.750 07:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.750 07:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:12.750 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:12.750 07:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.750 07:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.750 07:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.750 07:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:12.750 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:12.750 07:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.750 07:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.750 07:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.750 07:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:12.750 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:12.750 07:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:12.750 07:24:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:12.750 07:24:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:12.750 07:24:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:12.750 07:24:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:12.750 07:24:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:12.750 07:24:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:12.750 07:24:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:12.750 07:24:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:12.750 07:24:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:12.750 07:24:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:12.750 07:24:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:12.750 07:24:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:12.750 07:24:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:12.750 07:24:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:12.750 07:24:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:12.750 07:24:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:12.750 07:24:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:12.750 07:24:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:12.750 07:24:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:12.750 07:24:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:12.750 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:12.750 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:26:12.750 00:26:12.750 --- 10.0.0.2 ping statistics --- 00:26:12.750 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.750 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:26:12.750 07:24:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:12.750 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:12.750 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:26:12.750 00:26:12.750 --- 10.0.0.1 ping statistics --- 00:26:12.750 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.750 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:26:12.750 07:24:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:12.750 07:24:15 -- nvmf/common.sh@410 -- # return 0 00:26:12.750 07:24:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:12.750 07:24:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:12.750 07:24:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:12.750 07:24:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:12.750 07:24:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:12.750 07:24:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:12.750 07:24:15 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:12.750 07:24:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:12.750 07:24:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:12.750 07:24:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.750 07:24:15 -- nvmf/common.sh@469 -- # nvmfpid=2006851 00:26:12.750 07:24:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:12.750 07:24:15 -- nvmf/common.sh@470 -- # waitforlisten 2006851 00:26:12.750 07:24:15 -- common/autotest_common.sh@819 -- # '[' -z 2006851 ']' 00:26:12.750 07:24:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:12.750 07:24:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:12.750 07:24:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:12.750 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:12.750 07:24:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:12.750 07:24:15 -- common/autotest_common.sh@10 -- # set +x 00:26:12.750 [2024-10-16 07:24:15.505569] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:12.750 [2024-10-16 07:24:15.505671] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:12.750 EAL: No free 2048 kB hugepages reported on node 1 00:26:12.750 [2024-10-16 07:24:15.570438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:12.750 [2024-10-16 07:24:15.676228] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:12.750 [2024-10-16 07:24:15.676396] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:12.750 [2024-10-16 07:24:15.676413] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:12.750 [2024-10-16 07:24:15.676426] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:12.750 [2024-10-16 07:24:15.676455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:13.684 07:24:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:13.684 07:24:16 -- common/autotest_common.sh@852 -- # return 0 00:26:13.684 07:24:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:13.684 07:24:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 07:24:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:13.684 07:24:16 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:13.684 07:24:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 [2024-10-16 07:24:16.513191] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:13.684 07:24:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:13.684 07:24:16 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:13.684 07:24:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 [2024-10-16 07:24:16.521368] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:13.684 07:24:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:13.684 07:24:16 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:13.684 07:24:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 null0 00:26:13.684 07:24:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:13.684 07:24:16 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:13.684 07:24:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 null1 00:26:13.684 07:24:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:13.684 07:24:16 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:13.684 07:24:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:13.684 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.684 07:24:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:13.684 07:24:16 -- host/discovery.sh@45 -- # hostpid=2006955 00:26:13.684 07:24:16 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:13.684 07:24:16 -- host/discovery.sh@46 -- # waitforlisten 2006955 /tmp/host.sock 00:26:13.684 07:24:16 -- common/autotest_common.sh@819 -- # '[' -z 2006955 ']' 00:26:13.684 07:24:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:26:13.684 07:24:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:13.685 07:24:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:13.685 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:13.685 07:24:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:13.685 07:24:16 -- common/autotest_common.sh@10 -- # set +x 00:26:13.685 [2024-10-16 07:24:16.589505] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:13.685 [2024-10-16 07:24:16.589592] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2006955 ] 00:26:13.685 EAL: No free 2048 kB hugepages reported on node 1 00:26:13.943 [2024-10-16 07:24:16.650934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:13.943 [2024-10-16 07:24:16.765849] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:13.943 [2024-10-16 07:24:16.766042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:14.875 07:24:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:14.875 07:24:17 -- common/autotest_common.sh@852 -- # return 0 00:26:14.875 07:24:17 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:14.875 07:24:17 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:14.875 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.875 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.875 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.875 07:24:17 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:14.875 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.875 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.875 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.875 07:24:17 -- host/discovery.sh@72 -- # notify_id=0 00:26:14.875 07:24:17 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:14.875 07:24:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:14.875 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.875 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.875 07:24:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:14.875 07:24:17 -- host/discovery.sh@59 -- # sort 00:26:14.875 07:24:17 -- host/discovery.sh@59 -- # xargs 00:26:14.875 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.875 07:24:17 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@79 -- # get_bdev_list 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # sort 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # sort 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@83 -- # get_bdev_list 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # sort 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # sort 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@87 -- # get_bdev_list 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # sort 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@55 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:14.876 07:24:17 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 [2024-10-16 07:24:17.804949] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.876 07:24:17 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:14.876 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:14.876 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # sort 00:26:14.876 07:24:17 -- host/discovery.sh@59 -- # xargs 00:26:14.876 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:15.134 07:24:17 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:15.134 07:24:17 -- host/discovery.sh@93 -- # get_bdev_list 00:26:15.134 07:24:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.134 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:15.134 07:24:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.134 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:15.134 07:24:17 -- host/discovery.sh@55 -- # sort 00:26:15.134 07:24:17 -- host/discovery.sh@55 -- # xargs 00:26:15.134 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:15.134 07:24:17 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:15.134 07:24:17 -- host/discovery.sh@94 -- # get_notification_count 00:26:15.134 07:24:17 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:15.134 07:24:17 -- host/discovery.sh@74 -- # jq '. | length' 00:26:15.134 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:15.134 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:15.134 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:15.134 07:24:17 -- host/discovery.sh@74 -- # notification_count=0 00:26:15.134 07:24:17 -- host/discovery.sh@75 -- # notify_id=0 00:26:15.134 07:24:17 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:15.134 07:24:17 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:15.134 07:24:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:15.134 07:24:17 -- common/autotest_common.sh@10 -- # set +x 00:26:15.134 07:24:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:15.134 07:24:17 -- host/discovery.sh@100 -- # sleep 1 00:26:15.708 [2024-10-16 07:24:18.602436] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:15.708 [2024-10-16 07:24:18.602474] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:15.708 [2024-10-16 07:24:18.602507] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:15.966 [2024-10-16 07:24:18.730947] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:15.966 [2024-10-16 07:24:18.793576] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:15.966 [2024-10-16 07:24:18.793604] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:16.224 07:24:18 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:16.224 07:24:18 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.224 07:24:18 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.224 07:24:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.224 07:24:18 -- host/discovery.sh@59 -- # sort 00:26:16.224 07:24:18 -- common/autotest_common.sh@10 -- # set +x 00:26:16.224 07:24:18 -- host/discovery.sh@59 -- # xargs 00:26:16.224 07:24:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.224 07:24:18 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:16.224 07:24:18 -- host/discovery.sh@102 -- # get_bdev_list 00:26:16.224 07:24:18 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.224 07:24:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.224 07:24:18 -- common/autotest_common.sh@10 -- # set +x 00:26:16.224 07:24:18 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.224 07:24:18 -- host/discovery.sh@55 -- # sort 00:26:16.224 07:24:18 -- host/discovery.sh@55 -- # xargs 00:26:16.224 07:24:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.224 07:24:19 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:16.224 07:24:19 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:16.224 07:24:19 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:16.224 07:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.224 07:24:19 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:16.224 07:24:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.224 07:24:19 -- host/discovery.sh@63 -- # sort -n 00:26:16.224 07:24:19 -- host/discovery.sh@63 -- # xargs 00:26:16.224 07:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.224 07:24:19 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:16.224 07:24:19 -- host/discovery.sh@104 -- # get_notification_count 00:26:16.224 07:24:19 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:16.224 07:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.224 07:24:19 -- host/discovery.sh@74 -- # jq '. | length' 00:26:16.224 07:24:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.225 07:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.225 07:24:19 -- host/discovery.sh@74 -- # notification_count=1 00:26:16.225 07:24:19 -- host/discovery.sh@75 -- # notify_id=1 00:26:16.225 07:24:19 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:16.225 07:24:19 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:16.225 07:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:16.225 07:24:19 -- common/autotest_common.sh@10 -- # set +x 00:26:16.225 07:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:16.225 07:24:19 -- host/discovery.sh@109 -- # sleep 1 00:26:17.599 07:24:20 -- host/discovery.sh@110 -- # get_bdev_list 00:26:17.599 07:24:20 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:17.599 07:24:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:17.599 07:24:20 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:17.599 07:24:20 -- common/autotest_common.sh@10 -- # set +x 00:26:17.599 07:24:20 -- host/discovery.sh@55 -- # sort 00:26:17.599 07:24:20 -- host/discovery.sh@55 -- # xargs 00:26:17.599 07:24:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:17.599 07:24:20 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:17.599 07:24:20 -- host/discovery.sh@111 -- # get_notification_count 00:26:17.599 07:24:20 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:17.599 07:24:20 -- host/discovery.sh@74 -- # jq '. | length' 00:26:17.599 07:24:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:17.599 07:24:20 -- common/autotest_common.sh@10 -- # set +x 00:26:17.599 07:24:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:17.599 07:24:20 -- host/discovery.sh@74 -- # notification_count=1 00:26:17.599 07:24:20 -- host/discovery.sh@75 -- # notify_id=2 00:26:17.599 07:24:20 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:17.599 07:24:20 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:17.599 07:24:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:17.599 07:24:20 -- common/autotest_common.sh@10 -- # set +x 00:26:17.599 [2024-10-16 07:24:20.200381] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:17.599 [2024-10-16 07:24:20.200774] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:17.599 [2024-10-16 07:24:20.200833] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:17.599 07:24:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:17.599 07:24:20 -- host/discovery.sh@117 -- # sleep 1 00:26:17.599 [2024-10-16 07:24:20.329146] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:17.599 [2024-10-16 07:24:20.388676] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:17.599 [2024-10-16 07:24:20.388703] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:17.599 [2024-10-16 07:24:20.388714] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:18.533 07:24:21 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:18.533 07:24:21 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.533 07:24:21 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.533 07:24:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.533 07:24:21 -- host/discovery.sh@59 -- # sort 00:26:18.533 07:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:18.533 07:24:21 -- host/discovery.sh@59 -- # xargs 00:26:18.533 07:24:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@119 -- # get_bdev_list 00:26:18.533 07:24:21 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.533 07:24:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.533 07:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:18.533 07:24:21 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.533 07:24:21 -- host/discovery.sh@55 -- # sort 00:26:18.533 07:24:21 -- host/discovery.sh@55 -- # xargs 00:26:18.533 07:24:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:18.533 07:24:21 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:18.533 07:24:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.533 07:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:18.533 07:24:21 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:18.533 07:24:21 -- host/discovery.sh@63 -- # sort -n 00:26:18.533 07:24:21 -- host/discovery.sh@63 -- # xargs 00:26:18.533 07:24:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@121 -- # get_notification_count 00:26:18.533 07:24:21 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:18.533 07:24:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.533 07:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:18.533 07:24:21 -- host/discovery.sh@74 -- # jq '. | length' 00:26:18.533 07:24:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@74 -- # notification_count=0 00:26:18.533 07:24:21 -- host/discovery.sh@75 -- # notify_id=2 00:26:18.533 07:24:21 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:18.533 07:24:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:18.533 07:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:18.533 [2024-10-16 07:24:21.367993] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:18.533 [2024-10-16 07:24:21.368042] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:18.533 07:24:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:18.533 07:24:21 -- host/discovery.sh@127 -- # sleep 1 00:26:18.534 [2024-10-16 07:24:21.377334] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.534 [2024-10-16 07:24:21.377371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.534 [2024-10-16 07:24:21.377391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.534 [2024-10-16 07:24:21.377407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.534 [2024-10-16 07:24:21.377423] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.534 [2024-10-16 07:24:21.377438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.534 [2024-10-16 07:24:21.377453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.534 [2024-10-16 07:24:21.377468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.534 [2024-10-16 07:24:21.377492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.387338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.397384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.397673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.397835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.397862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.397878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.397901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.397923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.397938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.397954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.397975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.407469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.407626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.407810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.407836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.407852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.407873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.407908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.407922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.407935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.407953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.417545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.417719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.417947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.417974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.417990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.418012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.418050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.418065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.418079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.418106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.427626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.427801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.427949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.427975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.427990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.428012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.428032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.428045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.428058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.428096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.437702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.437887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.437982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.438006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.438021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.438042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.438062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.438075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.438087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.438105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.447790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.534 [2024-10-16 07:24:21.448012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.448182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.534 [2024-10-16 07:24:21.448210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab4810 with addr=10.0.0.2, port=4420 00:26:18.534 [2024-10-16 07:24:21.448227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab4810 is same with the state(5) to be set 00:26:18.534 [2024-10-16 07:24:21.448251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4810 (9): Bad file descriptor 00:26:18.534 [2024-10-16 07:24:21.448289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.534 [2024-10-16 07:24:21.448308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.534 [2024-10-16 07:24:21.448322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.534 [2024-10-16 07:24:21.448343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.534 [2024-10-16 07:24:21.454305] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:18.534 [2024-10-16 07:24:21.454345] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:19.468 07:24:22 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:19.468 07:24:22 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.468 07:24:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.468 07:24:22 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.468 07:24:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.468 07:24:22 -- host/discovery.sh@59 -- # sort 00:26:19.468 07:24:22 -- host/discovery.sh@59 -- # xargs 00:26:19.468 07:24:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@129 -- # get_bdev_list 00:26:19.726 07:24:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.726 07:24:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.726 07:24:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.726 07:24:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.726 07:24:22 -- host/discovery.sh@55 -- # sort 00:26:19.726 07:24:22 -- host/discovery.sh@55 -- # xargs 00:26:19.726 07:24:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:19.726 07:24:22 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:19.726 07:24:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.726 07:24:22 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:19.726 07:24:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.726 07:24:22 -- host/discovery.sh@63 -- # sort -n 00:26:19.726 07:24:22 -- host/discovery.sh@63 -- # xargs 00:26:19.726 07:24:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@131 -- # get_notification_count 00:26:19.726 07:24:22 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:19.726 07:24:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.726 07:24:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.726 07:24:22 -- host/discovery.sh@74 -- # jq '. | length' 00:26:19.726 07:24:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@74 -- # notification_count=0 00:26:19.726 07:24:22 -- host/discovery.sh@75 -- # notify_id=2 00:26:19.726 07:24:22 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:19.726 07:24:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.726 07:24:22 -- common/autotest_common.sh@10 -- # set +x 00:26:19.726 07:24:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.726 07:24:22 -- host/discovery.sh@135 -- # sleep 1 00:26:20.659 07:24:23 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:20.659 07:24:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.659 07:24:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:20.659 07:24:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.659 07:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:20.659 07:24:23 -- host/discovery.sh@59 -- # sort 00:26:20.659 07:24:23 -- host/discovery.sh@59 -- # xargs 00:26:20.659 07:24:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:20.659 07:24:23 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:20.917 07:24:23 -- host/discovery.sh@137 -- # get_bdev_list 00:26:20.917 07:24:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.917 07:24:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:20.917 07:24:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.917 07:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:20.917 07:24:23 -- host/discovery.sh@55 -- # sort 00:26:20.917 07:24:23 -- host/discovery.sh@55 -- # xargs 00:26:20.917 07:24:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:20.917 07:24:23 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:20.917 07:24:23 -- host/discovery.sh@138 -- # get_notification_count 00:26:20.917 07:24:23 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:20.917 07:24:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:20.917 07:24:23 -- host/discovery.sh@74 -- # jq '. | length' 00:26:20.917 07:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:20.917 07:24:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:20.917 07:24:23 -- host/discovery.sh@74 -- # notification_count=2 00:26:20.917 07:24:23 -- host/discovery.sh@75 -- # notify_id=4 00:26:20.917 07:24:23 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:20.917 07:24:23 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:20.917 07:24:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:20.917 07:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:21.850 [2024-10-16 07:24:24.708215] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:21.850 [2024-10-16 07:24:24.708239] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:21.850 [2024-10-16 07:24:24.708260] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.107 [2024-10-16 07:24:24.794534] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:22.107 [2024-10-16 07:24:24.894629] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:22.107 [2024-10-16 07:24:24.894670] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:22.107 07:24:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:22.107 07:24:24 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.107 07:24:24 -- common/autotest_common.sh@640 -- # local es=0 00:26:22.108 07:24:24 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.108 07:24:24 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.108 07:24:24 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.108 07:24:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 request: 00:26:22.108 { 00:26:22.108 "name": "nvme", 00:26:22.108 "trtype": "tcp", 00:26:22.108 "traddr": "10.0.0.2", 00:26:22.108 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:22.108 "adrfam": "ipv4", 00:26:22.108 "trsvcid": "8009", 00:26:22.108 "wait_for_attach": true, 00:26:22.108 "method": "bdev_nvme_start_discovery", 00:26:22.108 "req_id": 1 00:26:22.108 } 00:26:22.108 Got JSON-RPC error response 00:26:22.108 response: 00:26:22.108 { 00:26:22.108 "code": -17, 00:26:22.108 "message": "File exists" 00:26:22.108 } 00:26:22.108 07:24:24 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:22.108 07:24:24 -- common/autotest_common.sh@643 -- # es=1 00:26:22.108 07:24:24 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:22.108 07:24:24 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:22.108 07:24:24 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:22.108 07:24:24 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:22.108 07:24:24 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:22.108 07:24:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:24 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:22.108 07:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 07:24:24 -- host/discovery.sh@67 -- # sort 00:26:22.108 07:24:24 -- host/discovery.sh@67 -- # xargs 00:26:22.108 07:24:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:22.108 07:24:24 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:22.108 07:24:24 -- host/discovery.sh@147 -- # get_bdev_list 00:26:22.108 07:24:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.108 07:24:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.108 07:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 07:24:24 -- host/discovery.sh@55 -- # sort 00:26:22.108 07:24:24 -- host/discovery.sh@55 -- # xargs 00:26:22.108 07:24:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:22.108 07:24:24 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.108 07:24:24 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.108 07:24:24 -- common/autotest_common.sh@640 -- # local es=0 00:26:22.108 07:24:24 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.108 07:24:24 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:22.108 07:24:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.108 07:24:24 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.108 07:24:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 request: 00:26:22.108 { 00:26:22.108 "name": "nvme_second", 00:26:22.108 "trtype": "tcp", 00:26:22.108 "traddr": "10.0.0.2", 00:26:22.108 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:22.108 "adrfam": "ipv4", 00:26:22.108 "trsvcid": "8009", 00:26:22.108 "wait_for_attach": true, 00:26:22.108 "method": "bdev_nvme_start_discovery", 00:26:22.108 "req_id": 1 00:26:22.108 } 00:26:22.108 Got JSON-RPC error response 00:26:22.108 response: 00:26:22.108 { 00:26:22.108 "code": -17, 00:26:22.108 "message": "File exists" 00:26:22.108 } 00:26:22.108 07:24:25 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:22.108 07:24:25 -- common/autotest_common.sh@643 -- # es=1 00:26:22.108 07:24:25 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:22.108 07:24:25 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:22.108 07:24:25 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:22.108 07:24:25 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:22.108 07:24:25 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:22.108 07:24:25 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:22.108 07:24:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:25 -- host/discovery.sh@67 -- # sort 00:26:22.108 07:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 07:24:25 -- host/discovery.sh@67 -- # xargs 00:26:22.108 07:24:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:22.108 07:24:25 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:22.108 07:24:25 -- host/discovery.sh@153 -- # get_bdev_list 00:26:22.108 07:24:25 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.108 07:24:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.108 07:24:25 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.108 07:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.108 07:24:25 -- host/discovery.sh@55 -- # sort 00:26:22.108 07:24:25 -- host/discovery.sh@55 -- # xargs 00:26:22.366 07:24:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:22.366 07:24:25 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.366 07:24:25 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.366 07:24:25 -- common/autotest_common.sh@640 -- # local es=0 00:26:22.366 07:24:25 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.366 07:24:25 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:26:22.366 07:24:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.366 07:24:25 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:26:22.366 07:24:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:26:22.366 07:24:25 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.366 07:24:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:22.366 07:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:23.300 [2024-10-16 07:24:26.095176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.300 [2024-10-16 07:24:26.095330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.300 [2024-10-16 07:24:26.095369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xac00a0 with addr=10.0.0.2, port=8010 00:26:23.300 [2024-10-16 07:24:26.095393] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:23.300 [2024-10-16 07:24:26.095409] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:23.300 [2024-10-16 07:24:26.095422] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:24.234 [2024-10-16 07:24:27.097693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.234 [2024-10-16 07:24:27.097875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.234 [2024-10-16 07:24:27.097903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xaa4d30 with addr=10.0.0.2, port=8010 00:26:24.234 [2024-10-16 07:24:27.097922] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:24.234 [2024-10-16 07:24:27.097935] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:24.234 [2024-10-16 07:24:27.097947] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:25.169 [2024-10-16 07:24:28.099917] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:25.169 request: 00:26:25.169 { 00:26:25.169 "name": "nvme_second", 00:26:25.169 "trtype": "tcp", 00:26:25.169 "traddr": "10.0.0.2", 00:26:25.169 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:25.169 "adrfam": "ipv4", 00:26:25.169 "trsvcid": "8010", 00:26:25.169 "attach_timeout_ms": 3000, 00:26:25.169 "method": "bdev_nvme_start_discovery", 00:26:25.169 "req_id": 1 00:26:25.169 } 00:26:25.169 Got JSON-RPC error response 00:26:25.169 response: 00:26:25.169 { 00:26:25.169 "code": -110, 00:26:25.169 "message": "Connection timed out" 00:26:25.169 } 00:26:25.169 07:24:28 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:26:25.169 07:24:28 -- common/autotest_common.sh@643 -- # es=1 00:26:25.169 07:24:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:26:25.169 07:24:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:26:25.169 07:24:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:26:25.169 07:24:28 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:25.169 07:24:28 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:25.169 07:24:28 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:25.169 07:24:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:25.169 07:24:28 -- common/autotest_common.sh@10 -- # set +x 00:26:25.169 07:24:28 -- host/discovery.sh@67 -- # sort 00:26:25.169 07:24:28 -- host/discovery.sh@67 -- # xargs 00:26:25.427 07:24:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:25.427 07:24:28 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:25.427 07:24:28 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:25.427 07:24:28 -- host/discovery.sh@162 -- # kill 2006955 00:26:25.427 07:24:28 -- host/discovery.sh@163 -- # nvmftestfini 00:26:25.427 07:24:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:25.427 07:24:28 -- nvmf/common.sh@116 -- # sync 00:26:25.427 07:24:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:25.427 07:24:28 -- nvmf/common.sh@119 -- # set +e 00:26:25.427 07:24:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:25.427 07:24:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:25.427 rmmod nvme_tcp 00:26:25.427 rmmod nvme_fabrics 00:26:25.427 rmmod nvme_keyring 00:26:25.427 07:24:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:25.427 07:24:28 -- nvmf/common.sh@123 -- # set -e 00:26:25.427 07:24:28 -- nvmf/common.sh@124 -- # return 0 00:26:25.427 07:24:28 -- nvmf/common.sh@477 -- # '[' -n 2006851 ']' 00:26:25.427 07:24:28 -- nvmf/common.sh@478 -- # killprocess 2006851 00:26:25.427 07:24:28 -- common/autotest_common.sh@926 -- # '[' -z 2006851 ']' 00:26:25.427 07:24:28 -- common/autotest_common.sh@930 -- # kill -0 2006851 00:26:25.427 07:24:28 -- common/autotest_common.sh@931 -- # uname 00:26:25.427 07:24:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:25.427 07:24:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2006851 00:26:25.427 07:24:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:25.427 07:24:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:25.427 07:24:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2006851' 00:26:25.428 killing process with pid 2006851 00:26:25.428 07:24:28 -- common/autotest_common.sh@945 -- # kill 2006851 00:26:25.428 07:24:28 -- common/autotest_common.sh@950 -- # wait 2006851 00:26:25.686 07:24:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:25.686 07:24:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:25.686 07:24:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:25.686 07:24:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:25.686 07:24:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:25.686 07:24:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:25.686 07:24:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:25.686 07:24:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:28.216 07:24:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:28.216 00:26:28.216 real 0m17.367s 00:26:28.216 user 0m26.892s 00:26:28.216 sys 0m2.844s 00:26:28.216 07:24:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:28.216 07:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:28.216 ************************************ 00:26:28.216 END TEST nvmf_discovery 00:26:28.216 ************************************ 00:26:28.216 07:24:30 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:28.216 07:24:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:28.216 07:24:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:28.216 07:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:28.216 ************************************ 00:26:28.216 START TEST nvmf_discovery_remove_ifc 00:26:28.216 ************************************ 00:26:28.216 07:24:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:28.216 * Looking for test storage... 00:26:28.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:28.216 07:24:30 -- nvmf/common.sh@7 -- # uname -s 00:26:28.216 07:24:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:28.216 07:24:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:28.216 07:24:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:28.216 07:24:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:28.216 07:24:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:28.216 07:24:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:28.216 07:24:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:28.216 07:24:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:28.216 07:24:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:28.216 07:24:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:28.216 07:24:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:28.216 07:24:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:28.216 07:24:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:28.216 07:24:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:28.216 07:24:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:28.216 07:24:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:28.216 07:24:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:28.216 07:24:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:28.216 07:24:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:28.216 07:24:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.216 07:24:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.216 07:24:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.216 07:24:30 -- paths/export.sh@5 -- # export PATH 00:26:28.216 07:24:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.216 07:24:30 -- nvmf/common.sh@46 -- # : 0 00:26:28.216 07:24:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:28.216 07:24:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:28.216 07:24:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:28.216 07:24:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:28.216 07:24:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:28.216 07:24:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:28.216 07:24:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:28.216 07:24:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:28.216 07:24:30 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:28.216 07:24:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:28.216 07:24:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:28.216 07:24:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:28.216 07:24:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:28.216 07:24:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:28.216 07:24:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:28.216 07:24:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:28.216 07:24:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:28.216 07:24:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:28.216 07:24:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:28.216 07:24:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:28.216 07:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:30.120 07:24:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:30.120 07:24:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:30.120 07:24:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:30.120 07:24:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:30.120 07:24:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:30.120 07:24:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:30.120 07:24:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:30.120 07:24:32 -- nvmf/common.sh@294 -- # net_devs=() 00:26:30.120 07:24:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:30.120 07:24:32 -- nvmf/common.sh@295 -- # e810=() 00:26:30.120 07:24:32 -- nvmf/common.sh@295 -- # local -ga e810 00:26:30.120 07:24:32 -- nvmf/common.sh@296 -- # x722=() 00:26:30.120 07:24:32 -- nvmf/common.sh@296 -- # local -ga x722 00:26:30.120 07:24:32 -- nvmf/common.sh@297 -- # mlx=() 00:26:30.120 07:24:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:30.120 07:24:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:30.120 07:24:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.120 07:24:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:30.120 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:30.120 07:24:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.120 07:24:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:30.120 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:30.120 07:24:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.120 07:24:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.120 07:24:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.120 07:24:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:30.120 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:30.120 07:24:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.120 07:24:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.120 07:24:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.120 07:24:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:30.120 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:30.120 07:24:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:30.120 07:24:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:30.120 07:24:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:30.120 07:24:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:30.120 07:24:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:30.120 07:24:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:30.120 07:24:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:30.120 07:24:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:30.120 07:24:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:30.120 07:24:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:30.120 07:24:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:30.120 07:24:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:30.120 07:24:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:30.120 07:24:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:30.120 07:24:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:30.120 07:24:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:30.120 07:24:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:30.120 07:24:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:30.120 07:24:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:30.120 07:24:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:30.120 07:24:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:30.120 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:30.120 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:26:30.120 00:26:30.120 --- 10.0.0.2 ping statistics --- 00:26:30.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.120 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:26:30.120 07:24:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:30.120 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:30.120 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:26:30.120 00:26:30.120 --- 10.0.0.1 ping statistics --- 00:26:30.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.120 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:26:30.120 07:24:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:30.120 07:24:32 -- nvmf/common.sh@410 -- # return 0 00:26:30.120 07:24:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:30.120 07:24:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:30.120 07:24:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:30.120 07:24:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:30.120 07:24:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:30.120 07:24:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:30.120 07:24:33 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:30.120 07:24:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:30.120 07:24:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:30.120 07:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:30.120 07:24:33 -- nvmf/common.sh@469 -- # nvmfpid=2010475 00:26:30.120 07:24:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:30.120 07:24:33 -- nvmf/common.sh@470 -- # waitforlisten 2010475 00:26:30.120 07:24:33 -- common/autotest_common.sh@819 -- # '[' -z 2010475 ']' 00:26:30.120 07:24:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:30.120 07:24:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:30.120 07:24:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:30.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:30.120 07:24:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:30.120 07:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:30.120 [2024-10-16 07:24:33.050141] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:30.120 [2024-10-16 07:24:33.050214] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:30.379 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.379 [2024-10-16 07:24:33.117653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:30.379 [2024-10-16 07:24:33.227044] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:30.379 [2024-10-16 07:24:33.227191] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:30.379 [2024-10-16 07:24:33.227208] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:30.379 [2024-10-16 07:24:33.227220] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:30.379 [2024-10-16 07:24:33.227246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:31.312 07:24:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:31.312 07:24:34 -- common/autotest_common.sh@852 -- # return 0 00:26:31.312 07:24:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:31.312 07:24:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:31.312 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:31.312 07:24:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:31.312 07:24:34 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:31.312 07:24:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:31.312 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:31.312 [2024-10-16 07:24:34.051828] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:31.312 [2024-10-16 07:24:34.060038] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:31.312 null0 00:26:31.312 [2024-10-16 07:24:34.091949] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:31.312 07:24:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:31.312 07:24:34 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2010630 00:26:31.312 07:24:34 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:31.312 07:24:34 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2010630 /tmp/host.sock 00:26:31.312 07:24:34 -- common/autotest_common.sh@819 -- # '[' -z 2010630 ']' 00:26:31.312 07:24:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:26:31.312 07:24:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:31.312 07:24:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:31.312 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:31.312 07:24:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:31.312 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:31.312 [2024-10-16 07:24:34.151319] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:31.312 [2024-10-16 07:24:34.151394] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2010630 ] 00:26:31.312 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.312 [2024-10-16 07:24:34.210470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.570 [2024-10-16 07:24:34.326137] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:31.570 [2024-10-16 07:24:34.326318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:31.570 07:24:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:31.570 07:24:34 -- common/autotest_common.sh@852 -- # return 0 00:26:31.570 07:24:34 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:31.570 07:24:34 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:31.570 07:24:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:31.570 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:31.570 07:24:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:31.570 07:24:34 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:31.570 07:24:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:31.570 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:31.570 07:24:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:31.570 07:24:34 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:31.570 07:24:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:31.570 07:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:32.944 [2024-10-16 07:24:35.529485] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:32.944 [2024-10-16 07:24:35.529518] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:32.944 [2024-10-16 07:24:35.529546] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:32.944 [2024-10-16 07:24:35.656976] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:32.944 [2024-10-16 07:24:35.760811] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:32.944 [2024-10-16 07:24:35.760860] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:32.944 [2024-10-16 07:24:35.760898] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:32.944 [2024-10-16 07:24:35.760921] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:32.944 [2024-10-16 07:24:35.760943] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:32.944 07:24:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.944 07:24:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:32.944 07:24:35 -- common/autotest_common.sh@10 -- # set +x 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.944 07:24:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:32.944 07:24:35 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.202 07:24:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:33.202 07:24:35 -- common/autotest_common.sh@10 -- # set +x 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:33.202 07:24:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:33.202 07:24:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.135 07:24:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.135 07:24:36 -- common/autotest_common.sh@10 -- # set +x 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.135 07:24:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:34.135 07:24:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.144 07:24:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:35.144 07:24:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.144 07:24:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:35.144 07:24:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.144 07:24:37 -- common/autotest_common.sh@10 -- # set +x 00:26:35.144 07:24:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:35.144 07:24:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:35.144 07:24:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.144 07:24:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:35.144 07:24:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:36.106 07:24:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.106 07:24:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.106 07:24:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.106 07:24:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:36.106 07:24:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.106 07:24:39 -- common/autotest_common.sh@10 -- # set +x 00:26:36.106 07:24:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.106 07:24:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:36.363 07:24:39 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:36.363 07:24:39 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.297 07:24:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.297 07:24:40 -- common/autotest_common.sh@10 -- # set +x 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.297 07:24:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.297 07:24:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.229 07:24:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:38.229 07:24:41 -- common/autotest_common.sh@10 -- # set +x 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.229 07:24:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.229 07:24:41 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.488 [2024-10-16 07:24:41.202443] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:38.488 [2024-10-16 07:24:41.202508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.488 [2024-10-16 07:24:41.202533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.202552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.488 [2024-10-16 07:24:41.202568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.202584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.488 [2024-10-16 07:24:41.202599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.202615] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.488 [2024-10-16 07:24:41.202630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.202646] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.488 [2024-10-16 07:24:41.202660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.202675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1072430 is same with the state(5) to be set 00:26:38.488 [2024-10-16 07:24:41.212461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1072430 (9): Bad file descriptor 00:26:38.488 [2024-10-16 07:24:41.222547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.488 [2024-10-16 07:24:41.222576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.222622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:64 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.488 [2024-10-16 07:24:41.222642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.222661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:38.488 [2024-10-16 07:24:41.222676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.488 [2024-10-16 07:24:41.222809] bdev_nvme.c:1582:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x10abd40 was disconnected and freed in a reset ctrlr sequence. 00:26:38.488 [2024-10-16 07:24:41.222832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:39.422 07:24:42 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.422 07:24:42 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.422 07:24:42 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.422 07:24:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:39.422 07:24:42 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.422 07:24:42 -- common/autotest_common.sh@10 -- # set +x 00:26:39.422 07:24:42 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.422 [2024-10-16 07:24:42.275763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:40.797 [2024-10-16 07:24:43.299860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:40.797 [2024-10-16 07:24:43.299937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1072430 with addr=10.0.0.2, port=4420 00:26:40.797 [2024-10-16 07:24:43.299967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1072430 is same with the state(5) to be set 00:26:40.797 [2024-10-16 07:24:43.300018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:40.797 [2024-10-16 07:24:43.300038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:40.797 [2024-10-16 07:24:43.300066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:40.797 [2024-10-16 07:24:43.300083] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:40.797 [2024-10-16 07:24:43.300517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1072430 (9): Bad file descriptor 00:26:40.797 [2024-10-16 07:24:43.300589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:40.797 [2024-10-16 07:24:43.300636] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:40.797 [2024-10-16 07:24:43.300673] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.797 [2024-10-16 07:24:43.300694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.797 [2024-10-16 07:24:43.300745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.797 [2024-10-16 07:24:43.300763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.797 [2024-10-16 07:24:43.300777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.797 [2024-10-16 07:24:43.300790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.797 [2024-10-16 07:24:43.300804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.797 [2024-10-16 07:24:43.300817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.797 [2024-10-16 07:24:43.300837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.797 [2024-10-16 07:24:43.300851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.797 [2024-10-16 07:24:43.300865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:40.797 [2024-10-16 07:24:43.300907] bdev.c:4968:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 0 00:26:40.797 [2024-10-16 07:24:43.301017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1072840 (9): Bad file descriptor 00:26:40.797 [2024-10-16 07:24:43.302072] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:40.797 [2024-10-16 07:24:43.302095] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:40.797 07:24:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:40.797 07:24:43 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:40.797 07:24:43 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.363 [2024-10-16 07:24:44.303104] bdev_raid.c:3350:raid_bdev_examine_load_sb_cb: *ERROR*: Failed to examine bdev nvme0n1: Input/output error 00:26:41.363 [2024-10-16 07:24:44.303184] vbdev_gpt.c: 468:gpt_bdev_complete: *ERROR*: Gpt: bdev=nvme0n1 io error status=0 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.621 07:24:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.621 07:24:44 -- common/autotest_common.sh@10 -- # set +x 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.621 07:24:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.621 07:24:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.621 07:24:44 -- common/autotest_common.sh@10 -- # set +x 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.621 07:24:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:41.621 07:24:44 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.555 [2024-10-16 07:24:45.355870] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:42.555 [2024-10-16 07:24:45.355894] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:42.555 [2024-10-16 07:24:45.355919] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:42.555 [2024-10-16 07:24:45.443208] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:42.555 07:24:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.555 07:24:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.555 07:24:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.555 07:24:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:42.556 07:24:45 -- common/autotest_common.sh@10 -- # set +x 00:26:42.556 07:24:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.556 07:24:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.556 07:24:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:42.556 07:24:45 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:42.556 07:24:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.814 [2024-10-16 07:24:45.626576] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:42.814 [2024-10-16 07:24:45.626630] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:42.814 [2024-10-16 07:24:45.626667] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:42.814 [2024-10-16 07:24:45.626692] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:42.814 [2024-10-16 07:24:45.626708] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:42.814 [2024-10-16 07:24:45.634200] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x107f180 was disconnected and freed. delete nvme_qpair. 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.748 07:24:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:43.748 07:24:46 -- common/autotest_common.sh@10 -- # set +x 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.748 07:24:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:43.748 07:24:46 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2010630 00:26:43.748 07:24:46 -- common/autotest_common.sh@926 -- # '[' -z 2010630 ']' 00:26:43.748 07:24:46 -- common/autotest_common.sh@930 -- # kill -0 2010630 00:26:43.749 07:24:46 -- common/autotest_common.sh@931 -- # uname 00:26:43.749 07:24:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:43.749 07:24:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2010630 00:26:43.749 07:24:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:43.749 07:24:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:43.749 07:24:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2010630' 00:26:43.749 killing process with pid 2010630 00:26:43.749 07:24:46 -- common/autotest_common.sh@945 -- # kill 2010630 00:26:43.749 07:24:46 -- common/autotest_common.sh@950 -- # wait 2010630 00:26:44.007 07:24:46 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:44.007 07:24:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:44.007 07:24:46 -- nvmf/common.sh@116 -- # sync 00:26:44.007 07:24:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:44.007 07:24:46 -- nvmf/common.sh@119 -- # set +e 00:26:44.007 07:24:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:44.007 07:24:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:44.007 rmmod nvme_tcp 00:26:44.007 rmmod nvme_fabrics 00:26:44.007 rmmod nvme_keyring 00:26:44.007 07:24:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:44.007 07:24:46 -- nvmf/common.sh@123 -- # set -e 00:26:44.007 07:24:46 -- nvmf/common.sh@124 -- # return 0 00:26:44.007 07:24:46 -- nvmf/common.sh@477 -- # '[' -n 2010475 ']' 00:26:44.007 07:24:46 -- nvmf/common.sh@478 -- # killprocess 2010475 00:26:44.007 07:24:46 -- common/autotest_common.sh@926 -- # '[' -z 2010475 ']' 00:26:44.007 07:24:46 -- common/autotest_common.sh@930 -- # kill -0 2010475 00:26:44.007 07:24:46 -- common/autotest_common.sh@931 -- # uname 00:26:44.007 07:24:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:44.007 07:24:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2010475 00:26:44.007 07:24:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:44.007 07:24:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:44.007 07:24:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2010475' 00:26:44.007 killing process with pid 2010475 00:26:44.007 07:24:46 -- common/autotest_common.sh@945 -- # kill 2010475 00:26:44.007 07:24:46 -- common/autotest_common.sh@950 -- # wait 2010475 00:26:44.007 [2024-10-16 07:24:46.897513] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c2b50 is same with the state(5) to be set 00:26:44.007 [2024-10-16 07:24:46.897557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c2b50 is same with the state(5) to be set 00:26:44.265 07:24:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:44.265 07:24:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:44.265 07:24:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:44.265 07:24:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:44.265 07:24:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:44.265 07:24:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.265 07:24:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.265 07:24:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:46.811 07:24:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:46.811 00:26:46.811 real 0m18.590s 00:26:46.811 user 0m25.489s 00:26:46.811 sys 0m3.113s 00:26:46.811 07:24:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:46.811 07:24:49 -- common/autotest_common.sh@10 -- # set +x 00:26:46.811 ************************************ 00:26:46.811 END TEST nvmf_discovery_remove_ifc 00:26:46.811 ************************************ 00:26:46.811 07:24:49 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:46.811 07:24:49 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:46.811 07:24:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:46.811 07:24:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:46.811 07:24:49 -- common/autotest_common.sh@10 -- # set +x 00:26:46.811 ************************************ 00:26:46.811 START TEST nvmf_digest 00:26:46.811 ************************************ 00:26:46.811 07:24:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:46.811 * Looking for test storage... 00:26:46.811 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:46.811 07:24:49 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:46.811 07:24:49 -- nvmf/common.sh@7 -- # uname -s 00:26:46.811 07:24:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:46.811 07:24:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:46.811 07:24:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:46.811 07:24:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:46.811 07:24:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:46.811 07:24:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:46.811 07:24:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:46.811 07:24:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:46.811 07:24:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:46.811 07:24:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:46.811 07:24:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:46.811 07:24:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:46.811 07:24:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:46.811 07:24:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:46.811 07:24:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:46.811 07:24:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:46.811 07:24:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:46.811 07:24:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:46.811 07:24:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:46.811 07:24:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.811 07:24:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.811 07:24:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.811 07:24:49 -- paths/export.sh@5 -- # export PATH 00:26:46.811 07:24:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.811 07:24:49 -- nvmf/common.sh@46 -- # : 0 00:26:46.811 07:24:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:46.811 07:24:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:46.811 07:24:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:46.811 07:24:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:46.811 07:24:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:46.811 07:24:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:46.811 07:24:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:46.811 07:24:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:46.811 07:24:49 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:46.811 07:24:49 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:46.811 07:24:49 -- host/digest.sh@16 -- # runtime=2 00:26:46.811 07:24:49 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:46.811 07:24:49 -- host/digest.sh@132 -- # nvmftestinit 00:26:46.812 07:24:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:46.812 07:24:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:46.812 07:24:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:46.812 07:24:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:46.812 07:24:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:46.812 07:24:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:46.812 07:24:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:46.812 07:24:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:46.812 07:24:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:46.812 07:24:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:46.812 07:24:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:46.812 07:24:49 -- common/autotest_common.sh@10 -- # set +x 00:26:48.713 07:24:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:48.713 07:24:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:48.713 07:24:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:48.713 07:24:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:48.713 07:24:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:48.713 07:24:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:48.713 07:24:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:48.713 07:24:51 -- nvmf/common.sh@294 -- # net_devs=() 00:26:48.713 07:24:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:48.713 07:24:51 -- nvmf/common.sh@295 -- # e810=() 00:26:48.713 07:24:51 -- nvmf/common.sh@295 -- # local -ga e810 00:26:48.713 07:24:51 -- nvmf/common.sh@296 -- # x722=() 00:26:48.713 07:24:51 -- nvmf/common.sh@296 -- # local -ga x722 00:26:48.713 07:24:51 -- nvmf/common.sh@297 -- # mlx=() 00:26:48.713 07:24:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:48.713 07:24:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:48.713 07:24:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:48.713 07:24:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:48.713 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:48.713 07:24:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:48.713 07:24:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:48.713 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:48.713 07:24:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:48.713 07:24:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:48.713 07:24:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:48.713 07:24:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:48.713 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:48.713 07:24:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:48.713 07:24:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:48.713 07:24:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:48.713 07:24:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:48.713 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:48.713 07:24:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:48.713 07:24:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:48.713 07:24:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:48.713 07:24:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:48.713 07:24:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:48.713 07:24:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:48.713 07:24:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:48.713 07:24:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:48.713 07:24:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:48.713 07:24:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:48.713 07:24:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:48.713 07:24:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:48.713 07:24:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:48.713 07:24:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:48.713 07:24:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:48.713 07:24:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:48.713 07:24:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:48.713 07:24:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:48.713 07:24:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:48.713 07:24:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:48.713 07:24:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:48.713 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:48.713 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:26:48.713 00:26:48.713 --- 10.0.0.2 ping statistics --- 00:26:48.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:48.713 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:26:48.713 07:24:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:48.713 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:48.713 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:26:48.713 00:26:48.713 --- 10.0.0.1 ping statistics --- 00:26:48.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:48.713 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:26:48.713 07:24:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:48.713 07:24:51 -- nvmf/common.sh@410 -- # return 0 00:26:48.713 07:24:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:48.713 07:24:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:48.713 07:24:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:48.713 07:24:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:48.714 07:24:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:48.714 07:24:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:48.714 07:24:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:48.714 07:24:51 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:48.714 07:24:51 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:48.714 07:24:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:48.714 07:24:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:48.714 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.714 ************************************ 00:26:48.714 START TEST nvmf_digest_clean 00:26:48.714 ************************************ 00:26:48.714 07:24:51 -- common/autotest_common.sh@1104 -- # run_digest 00:26:48.714 07:24:51 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:48.714 07:24:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:48.714 07:24:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:48.714 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.714 07:24:51 -- nvmf/common.sh@469 -- # nvmfpid=2014155 00:26:48.714 07:24:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:48.714 07:24:51 -- nvmf/common.sh@470 -- # waitforlisten 2014155 00:26:48.714 07:24:51 -- common/autotest_common.sh@819 -- # '[' -z 2014155 ']' 00:26:48.714 07:24:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:48.714 07:24:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:48.714 07:24:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:48.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:48.714 07:24:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:48.714 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.714 [2024-10-16 07:24:51.515327] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:48.714 [2024-10-16 07:24:51.515410] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:48.714 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.714 [2024-10-16 07:24:51.582781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:48.973 [2024-10-16 07:24:51.696604] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:48.973 [2024-10-16 07:24:51.696786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:48.973 [2024-10-16 07:24:51.696808] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:48.973 [2024-10-16 07:24:51.696823] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:48.973 [2024-10-16 07:24:51.696863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:48.973 07:24:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:48.973 07:24:51 -- common/autotest_common.sh@852 -- # return 0 00:26:48.973 07:24:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:48.973 07:24:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:48.973 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.973 07:24:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:48.973 07:24:51 -- host/digest.sh@120 -- # common_target_config 00:26:48.973 07:24:51 -- host/digest.sh@43 -- # rpc_cmd 00:26:48.973 07:24:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:48.973 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.973 null0 00:26:48.973 [2024-10-16 07:24:51.876038] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:48.973 [2024-10-16 07:24:51.900271] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:48.973 07:24:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:48.973 07:24:51 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:48.973 07:24:51 -- host/digest.sh@77 -- # local rw bs qd 00:26:48.973 07:24:51 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:48.973 07:24:51 -- host/digest.sh@80 -- # rw=randread 00:26:48.973 07:24:51 -- host/digest.sh@80 -- # bs=4096 00:26:48.973 07:24:51 -- host/digest.sh@80 -- # qd=128 00:26:48.973 07:24:51 -- host/digest.sh@82 -- # bperfpid=2014186 00:26:48.973 07:24:51 -- host/digest.sh@83 -- # waitforlisten 2014186 /var/tmp/bperf.sock 00:26:48.973 07:24:51 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:48.973 07:24:51 -- common/autotest_common.sh@819 -- # '[' -z 2014186 ']' 00:26:48.973 07:24:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:48.973 07:24:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:48.973 07:24:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:48.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:48.973 07:24:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:48.973 07:24:51 -- common/autotest_common.sh@10 -- # set +x 00:26:49.231 [2024-10-16 07:24:51.942523] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:49.231 [2024-10-16 07:24:51.942597] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2014186 ] 00:26:49.231 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.231 [2024-10-16 07:24:52.006153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.231 [2024-10-16 07:24:52.123061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.231 07:24:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:49.231 07:24:52 -- common/autotest_common.sh@852 -- # return 0 00:26:49.231 07:24:52 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:49.231 07:24:52 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:49.231 07:24:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:49.798 07:24:52 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.798 07:24:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.056 nvme0n1 00:26:50.056 07:24:52 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:50.056 07:24:52 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:50.056 Running I/O for 2 seconds... 00:26:52.585 00:26:52.585 Latency(us) 00:26:52.585 [2024-10-16T05:24:55.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.585 [2024-10-16T05:24:55.525Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:52.585 nvme0n1 : 2.05 15902.42 62.12 0.00 0.00 7884.62 3640.89 47962.64 00:26:52.585 [2024-10-16T05:24:55.525Z] =================================================================================================================== 00:26:52.585 [2024-10-16T05:24:55.525Z] Total : 15902.42 62.12 0.00 0.00 7884.62 3640.89 47962.64 00:26:52.585 0 00:26:52.585 07:24:54 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:52.585 07:24:54 -- host/digest.sh@92 -- # get_accel_stats 00:26:52.585 07:24:55 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:52.585 07:24:55 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:52.585 | select(.opcode=="crc32c") 00:26:52.585 | "\(.module_name) \(.executed)"' 00:26:52.585 07:24:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:52.585 07:24:55 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:52.585 07:24:55 -- host/digest.sh@93 -- # exp_module=software 00:26:52.585 07:24:55 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:52.585 07:24:55 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:52.585 07:24:55 -- host/digest.sh@97 -- # killprocess 2014186 00:26:52.585 07:24:55 -- common/autotest_common.sh@926 -- # '[' -z 2014186 ']' 00:26:52.585 07:24:55 -- common/autotest_common.sh@930 -- # kill -0 2014186 00:26:52.585 07:24:55 -- common/autotest_common.sh@931 -- # uname 00:26:52.585 07:24:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:52.585 07:24:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2014186 00:26:52.585 07:24:55 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:52.585 07:24:55 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:52.585 07:24:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2014186' 00:26:52.585 killing process with pid 2014186 00:26:52.585 07:24:55 -- common/autotest_common.sh@945 -- # kill 2014186 00:26:52.585 Received shutdown signal, test time was about 2.000000 seconds 00:26:52.585 00:26:52.585 Latency(us) 00:26:52.585 [2024-10-16T05:24:55.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.585 [2024-10-16T05:24:55.525Z] =================================================================================================================== 00:26:52.585 [2024-10-16T05:24:55.525Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:52.585 07:24:55 -- common/autotest_common.sh@950 -- # wait 2014186 00:26:52.843 07:24:55 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:52.843 07:24:55 -- host/digest.sh@77 -- # local rw bs qd 00:26:52.843 07:24:55 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:52.843 07:24:55 -- host/digest.sh@80 -- # rw=randread 00:26:52.843 07:24:55 -- host/digest.sh@80 -- # bs=131072 00:26:52.843 07:24:55 -- host/digest.sh@80 -- # qd=16 00:26:52.843 07:24:55 -- host/digest.sh@82 -- # bperfpid=2014735 00:26:52.843 07:24:55 -- host/digest.sh@83 -- # waitforlisten 2014735 /var/tmp/bperf.sock 00:26:52.843 07:24:55 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:52.843 07:24:55 -- common/autotest_common.sh@819 -- # '[' -z 2014735 ']' 00:26:52.843 07:24:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:52.843 07:24:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:52.843 07:24:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:52.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:52.843 07:24:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:52.843 07:24:55 -- common/autotest_common.sh@10 -- # set +x 00:26:52.843 [2024-10-16 07:24:55.593886] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:52.843 [2024-10-16 07:24:55.593958] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2014735 ] 00:26:52.843 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:52.843 Zero copy mechanism will not be used. 00:26:52.843 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.843 [2024-10-16 07:24:55.653139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:52.843 [2024-10-16 07:24:55.759885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.101 07:24:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:53.101 07:24:55 -- common/autotest_common.sh@852 -- # return 0 00:26:53.101 07:24:55 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.101 07:24:55 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.101 07:24:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.359 07:24:56 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.359 07:24:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.616 nvme0n1 00:26:53.616 07:24:56 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:53.616 07:24:56 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:53.874 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:53.874 Zero copy mechanism will not be used. 00:26:53.874 Running I/O for 2 seconds... 00:26:55.785 00:26:55.785 Latency(us) 00:26:55.785 [2024-10-16T05:24:58.725Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.785 [2024-10-16T05:24:58.725Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:55.785 nvme0n1 : 2.00 6098.16 762.27 0.00 0.00 2619.71 703.91 9417.77 00:26:55.785 [2024-10-16T05:24:58.725Z] =================================================================================================================== 00:26:55.785 [2024-10-16T05:24:58.725Z] Total : 6098.16 762.27 0.00 0.00 2619.71 703.91 9417.77 00:26:55.785 0 00:26:55.785 07:24:58 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:55.785 07:24:58 -- host/digest.sh@92 -- # get_accel_stats 00:26:55.785 07:24:58 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:55.785 07:24:58 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:55.785 | select(.opcode=="crc32c") 00:26:55.785 | "\(.module_name) \(.executed)"' 00:26:55.785 07:24:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.042 07:24:58 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.042 07:24:58 -- host/digest.sh@93 -- # exp_module=software 00:26:56.042 07:24:58 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.043 07:24:58 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.043 07:24:58 -- host/digest.sh@97 -- # killprocess 2014735 00:26:56.043 07:24:58 -- common/autotest_common.sh@926 -- # '[' -z 2014735 ']' 00:26:56.043 07:24:58 -- common/autotest_common.sh@930 -- # kill -0 2014735 00:26:56.043 07:24:58 -- common/autotest_common.sh@931 -- # uname 00:26:56.043 07:24:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:56.043 07:24:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2014735 00:26:56.043 07:24:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:56.043 07:24:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:56.043 07:24:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2014735' 00:26:56.043 killing process with pid 2014735 00:26:56.043 07:24:58 -- common/autotest_common.sh@945 -- # kill 2014735 00:26:56.043 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.043 00:26:56.043 Latency(us) 00:26:56.043 [2024-10-16T05:24:58.983Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.043 [2024-10-16T05:24:58.983Z] =================================================================================================================== 00:26:56.043 [2024-10-16T05:24:58.983Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.043 07:24:58 -- common/autotest_common.sh@950 -- # wait 2014735 00:26:56.301 07:24:59 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:56.301 07:24:59 -- host/digest.sh@77 -- # local rw bs qd 00:26:56.301 07:24:59 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:56.301 07:24:59 -- host/digest.sh@80 -- # rw=randwrite 00:26:56.301 07:24:59 -- host/digest.sh@80 -- # bs=4096 00:26:56.301 07:24:59 -- host/digest.sh@80 -- # qd=128 00:26:56.301 07:24:59 -- host/digest.sh@82 -- # bperfpid=2015156 00:26:56.301 07:24:59 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:56.301 07:24:59 -- host/digest.sh@83 -- # waitforlisten 2015156 /var/tmp/bperf.sock 00:26:56.301 07:24:59 -- common/autotest_common.sh@819 -- # '[' -z 2015156 ']' 00:26:56.301 07:24:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.301 07:24:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:56.301 07:24:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.301 07:24:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:56.301 07:24:59 -- common/autotest_common.sh@10 -- # set +x 00:26:56.559 [2024-10-16 07:24:59.251604] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:26:56.559 [2024-10-16 07:24:59.251685] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2015156 ] 00:26:56.559 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.559 [2024-10-16 07:24:59.327394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.559 [2024-10-16 07:24:59.457039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:56.817 07:24:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:56.817 07:24:59 -- common/autotest_common.sh@852 -- # return 0 00:26:56.817 07:24:59 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:56.817 07:24:59 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:56.817 07:24:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.075 07:24:59 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.075 07:24:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.641 nvme0n1 00:26:57.641 07:25:00 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:57.641 07:25:00 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:57.641 Running I/O for 2 seconds... 00:26:59.539 00:26:59.539 Latency(us) 00:26:59.539 [2024-10-16T05:25:02.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.539 [2024-10-16T05:25:02.479Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:59.539 nvme0n1 : 2.01 20395.65 79.67 0.00 0.00 6262.01 2560.76 13495.56 00:26:59.539 [2024-10-16T05:25:02.479Z] =================================================================================================================== 00:26:59.539 [2024-10-16T05:25:02.479Z] Total : 20395.65 79.67 0.00 0.00 6262.01 2560.76 13495.56 00:26:59.539 0 00:26:59.539 07:25:02 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:59.539 07:25:02 -- host/digest.sh@92 -- # get_accel_stats 00:26:59.539 07:25:02 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:59.539 07:25:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:59.539 07:25:02 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:59.539 | select(.opcode=="crc32c") 00:26:59.539 | "\(.module_name) \(.executed)"' 00:26:59.797 07:25:02 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:59.797 07:25:02 -- host/digest.sh@93 -- # exp_module=software 00:26:59.797 07:25:02 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:59.797 07:25:02 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:59.797 07:25:02 -- host/digest.sh@97 -- # killprocess 2015156 00:26:59.797 07:25:02 -- common/autotest_common.sh@926 -- # '[' -z 2015156 ']' 00:26:59.797 07:25:02 -- common/autotest_common.sh@930 -- # kill -0 2015156 00:26:59.797 07:25:02 -- common/autotest_common.sh@931 -- # uname 00:26:59.797 07:25:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:59.797 07:25:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2015156 00:26:59.797 07:25:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:59.797 07:25:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:59.797 07:25:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2015156' 00:26:59.797 killing process with pid 2015156 00:26:59.797 07:25:02 -- common/autotest_common.sh@945 -- # kill 2015156 00:26:59.797 Received shutdown signal, test time was about 2.000000 seconds 00:26:59.797 00:26:59.797 Latency(us) 00:26:59.797 [2024-10-16T05:25:02.737Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.797 [2024-10-16T05:25:02.737Z] =================================================================================================================== 00:26:59.797 [2024-10-16T05:25:02.737Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:59.797 07:25:02 -- common/autotest_common.sh@950 -- # wait 2015156 00:27:00.055 07:25:02 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:00.055 07:25:02 -- host/digest.sh@77 -- # local rw bs qd 00:27:00.055 07:25:02 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:00.055 07:25:02 -- host/digest.sh@80 -- # rw=randwrite 00:27:00.055 07:25:02 -- host/digest.sh@80 -- # bs=131072 00:27:00.055 07:25:02 -- host/digest.sh@80 -- # qd=16 00:27:00.055 07:25:02 -- host/digest.sh@82 -- # bperfpid=2015578 00:27:00.055 07:25:02 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:00.055 07:25:02 -- host/digest.sh@83 -- # waitforlisten 2015578 /var/tmp/bperf.sock 00:27:00.055 07:25:02 -- common/autotest_common.sh@819 -- # '[' -z 2015578 ']' 00:27:00.055 07:25:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.055 07:25:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:00.055 07:25:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.055 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.055 07:25:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:00.055 07:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:00.314 [2024-10-16 07:25:03.021176] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:00.314 [2024-10-16 07:25:03.021254] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2015578 ] 00:27:00.314 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.314 Zero copy mechanism will not be used. 00:27:00.314 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.314 [2024-10-16 07:25:03.077616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.314 [2024-10-16 07:25:03.183690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:00.314 07:25:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:00.314 07:25:03 -- common/autotest_common.sh@852 -- # return 0 00:27:00.314 07:25:03 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:00.314 07:25:03 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:00.314 07:25:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:00.881 07:25:03 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:00.881 07:25:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.144 nvme0n1 00:27:01.144 07:25:04 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:01.144 07:25:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:01.451 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:01.451 Zero copy mechanism will not be used. 00:27:01.451 Running I/O for 2 seconds... 00:27:03.377 00:27:03.377 Latency(us) 00:27:03.377 [2024-10-16T05:25:06.317Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.377 [2024-10-16T05:25:06.317Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:03.377 nvme0n1 : 2.00 6804.70 850.59 0.00 0.00 2344.10 1784.04 5679.79 00:27:03.377 [2024-10-16T05:25:06.317Z] =================================================================================================================== 00:27:03.377 [2024-10-16T05:25:06.317Z] Total : 6804.70 850.59 0.00 0.00 2344.10 1784.04 5679.79 00:27:03.377 0 00:27:03.377 07:25:06 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:03.377 07:25:06 -- host/digest.sh@92 -- # get_accel_stats 00:27:03.377 07:25:06 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:03.377 07:25:06 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:03.377 | select(.opcode=="crc32c") 00:27:03.377 | "\(.module_name) \(.executed)"' 00:27:03.377 07:25:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:03.634 07:25:06 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:03.634 07:25:06 -- host/digest.sh@93 -- # exp_module=software 00:27:03.634 07:25:06 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:03.634 07:25:06 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:03.634 07:25:06 -- host/digest.sh@97 -- # killprocess 2015578 00:27:03.634 07:25:06 -- common/autotest_common.sh@926 -- # '[' -z 2015578 ']' 00:27:03.634 07:25:06 -- common/autotest_common.sh@930 -- # kill -0 2015578 00:27:03.635 07:25:06 -- common/autotest_common.sh@931 -- # uname 00:27:03.635 07:25:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:03.635 07:25:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2015578 00:27:03.635 07:25:06 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:03.635 07:25:06 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:03.635 07:25:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2015578' 00:27:03.635 killing process with pid 2015578 00:27:03.635 07:25:06 -- common/autotest_common.sh@945 -- # kill 2015578 00:27:03.635 Received shutdown signal, test time was about 2.000000 seconds 00:27:03.635 00:27:03.635 Latency(us) 00:27:03.635 [2024-10-16T05:25:06.575Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.635 [2024-10-16T05:25:06.575Z] =================================================================================================================== 00:27:03.635 [2024-10-16T05:25:06.575Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:03.635 07:25:06 -- common/autotest_common.sh@950 -- # wait 2015578 00:27:03.892 07:25:06 -- host/digest.sh@126 -- # killprocess 2014155 00:27:03.892 07:25:06 -- common/autotest_common.sh@926 -- # '[' -z 2014155 ']' 00:27:03.892 07:25:06 -- common/autotest_common.sh@930 -- # kill -0 2014155 00:27:03.892 07:25:06 -- common/autotest_common.sh@931 -- # uname 00:27:03.892 07:25:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:03.892 07:25:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2014155 00:27:03.892 07:25:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:03.892 07:25:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:03.892 07:25:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2014155' 00:27:03.892 killing process with pid 2014155 00:27:03.892 07:25:06 -- common/autotest_common.sh@945 -- # kill 2014155 00:27:03.892 07:25:06 -- common/autotest_common.sh@950 -- # wait 2014155 00:27:04.150 00:27:04.150 real 0m15.566s 00:27:04.150 user 0m30.996s 00:27:04.150 sys 0m4.304s 00:27:04.150 07:25:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:04.150 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.150 ************************************ 00:27:04.150 END TEST nvmf_digest_clean 00:27:04.150 ************************************ 00:27:04.150 07:25:07 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:04.150 07:25:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:04.150 07:25:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:04.150 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.150 ************************************ 00:27:04.150 START TEST nvmf_digest_error 00:27:04.150 ************************************ 00:27:04.150 07:25:07 -- common/autotest_common.sh@1104 -- # run_digest_error 00:27:04.150 07:25:07 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:04.150 07:25:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:04.150 07:25:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:04.150 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.150 07:25:07 -- nvmf/common.sh@469 -- # nvmfpid=2016148 00:27:04.150 07:25:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:04.150 07:25:07 -- nvmf/common.sh@470 -- # waitforlisten 2016148 00:27:04.150 07:25:07 -- common/autotest_common.sh@819 -- # '[' -z 2016148 ']' 00:27:04.150 07:25:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:04.150 07:25:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:04.150 07:25:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:04.150 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:04.150 07:25:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:04.150 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.409 [2024-10-16 07:25:07.106422] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:04.409 [2024-10-16 07:25:07.106503] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:04.409 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.409 [2024-10-16 07:25:07.169165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.409 [2024-10-16 07:25:07.280299] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:04.409 [2024-10-16 07:25:07.280465] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:04.409 [2024-10-16 07:25:07.280485] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:04.409 [2024-10-16 07:25:07.280500] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:04.409 [2024-10-16 07:25:07.280540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:04.409 07:25:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:04.409 07:25:07 -- common/autotest_common.sh@852 -- # return 0 00:27:04.409 07:25:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:04.409 07:25:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:04.409 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.409 07:25:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:04.409 07:25:07 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:04.409 07:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.409 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.409 [2024-10-16 07:25:07.349152] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:04.666 07:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.666 07:25:07 -- host/digest.sh@104 -- # common_target_config 00:27:04.666 07:25:07 -- host/digest.sh@43 -- # rpc_cmd 00:27:04.666 07:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:04.666 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.666 null0 00:27:04.666 [2024-10-16 07:25:07.472123] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:04.666 [2024-10-16 07:25:07.496354] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:04.666 07:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:04.666 07:25:07 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:04.666 07:25:07 -- host/digest.sh@54 -- # local rw bs qd 00:27:04.666 07:25:07 -- host/digest.sh@56 -- # rw=randread 00:27:04.666 07:25:07 -- host/digest.sh@56 -- # bs=4096 00:27:04.666 07:25:07 -- host/digest.sh@56 -- # qd=128 00:27:04.666 07:25:07 -- host/digest.sh@58 -- # bperfpid=2016172 00:27:04.666 07:25:07 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:04.666 07:25:07 -- host/digest.sh@60 -- # waitforlisten 2016172 /var/tmp/bperf.sock 00:27:04.666 07:25:07 -- common/autotest_common.sh@819 -- # '[' -z 2016172 ']' 00:27:04.666 07:25:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.666 07:25:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:04.666 07:25:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.666 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.666 07:25:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:04.666 07:25:07 -- common/autotest_common.sh@10 -- # set +x 00:27:04.666 [2024-10-16 07:25:07.539533] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:04.666 [2024-10-16 07:25:07.539605] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2016172 ] 00:27:04.666 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.666 [2024-10-16 07:25:07.599940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.924 [2024-10-16 07:25:07.716127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:05.858 07:25:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:05.858 07:25:08 -- common/autotest_common.sh@852 -- # return 0 00:27:05.859 07:25:08 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.859 07:25:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.859 07:25:08 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:05.859 07:25:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:05.859 07:25:08 -- common/autotest_common.sh@10 -- # set +x 00:27:05.859 07:25:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:05.859 07:25:08 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.859 07:25:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.425 nvme0n1 00:27:06.425 07:25:09 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:06.425 07:25:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:06.425 07:25:09 -- common/autotest_common.sh@10 -- # set +x 00:27:06.425 07:25:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:06.425 07:25:09 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:06.425 07:25:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:06.425 Running I/O for 2 seconds... 00:27:06.425 [2024-10-16 07:25:09.286281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.286332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:4981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.286356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.425 [2024-10-16 07:25:09.303263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.303308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.303328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.425 [2024-10-16 07:25:09.318863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.318905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.318938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.425 [2024-10-16 07:25:09.330969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.331001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.331018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.425 [2024-10-16 07:25:09.348542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.348577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:1522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.348596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.425 [2024-10-16 07:25:09.361790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.425 [2024-10-16 07:25:09.361820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.425 [2024-10-16 07:25:09.361846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.683 [2024-10-16 07:25:09.375489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.683 [2024-10-16 07:25:09.375524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.683 [2024-10-16 07:25:09.375542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.683 [2024-10-16 07:25:09.391446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.683 [2024-10-16 07:25:09.391480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:12323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.683 [2024-10-16 07:25:09.391499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.683 [2024-10-16 07:25:09.408427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.683 [2024-10-16 07:25:09.408461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:21647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.683 [2024-10-16 07:25:09.408480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.683 [2024-10-16 07:25:09.425857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.683 [2024-10-16 07:25:09.425887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:21923 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.683 [2024-10-16 07:25:09.425905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.683 [2024-10-16 07:25:09.437591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.683 [2024-10-16 07:25:09.437624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:1298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.437643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.453684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.453719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:10822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.453747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.471662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.471697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:21312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.471716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.482927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.482955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5832 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.482986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.498894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.498922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:4272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.498951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.517021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.517056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23571 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.517075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.532903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.532934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:11882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.532950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.544569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.544602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:2414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.544619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.561690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.561725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19589 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.561756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.578668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.578702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:1459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.578735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.595504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.595538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.595557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.684 [2024-10-16 07:25:09.612640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.684 [2024-10-16 07:25:09.612674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.684 [2024-10-16 07:25:09.612693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.942 [2024-10-16 07:25:09.629804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.942 [2024-10-16 07:25:09.629832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:15583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.942 [2024-10-16 07:25:09.629863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.942 [2024-10-16 07:25:09.647628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.942 [2024-10-16 07:25:09.647661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:9281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.942 [2024-10-16 07:25:09.647680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.942 [2024-10-16 07:25:09.663702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.942 [2024-10-16 07:25:09.663742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.942 [2024-10-16 07:25:09.663762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.942 [2024-10-16 07:25:09.687981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.942 [2024-10-16 07:25:09.688029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:19124 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.942 [2024-10-16 07:25:09.688048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.942 [2024-10-16 07:25:09.705141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.942 [2024-10-16 07:25:09.705177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:7545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.942 [2024-10-16 07:25:09.705196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.722160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.722194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6085 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.722213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.739044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.739077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:4941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.739096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.755989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.756035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:22246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.756054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.770902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.770932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:23427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.770949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.782948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.782975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.783009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.798399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.798433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.798451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.816077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.816110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:16319 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.816128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.832351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.832383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:25498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.832402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.850618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.850651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.850670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.866860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.866888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.866924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.943 [2024-10-16 07:25:09.884012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:06.943 [2024-10-16 07:25:09.884039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:9952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.943 [2024-10-16 07:25:09.884071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.201 [2024-10-16 07:25:09.900907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.201 [2024-10-16 07:25:09.900936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:14283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.201 [2024-10-16 07:25:09.900966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.201 [2024-10-16 07:25:09.917820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.201 [2024-10-16 07:25:09.917847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:21128 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.201 [2024-10-16 07:25:09.917876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.201 [2024-10-16 07:25:09.934525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.201 [2024-10-16 07:25:09.934559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:20672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.201 [2024-10-16 07:25:09.934578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.201 [2024-10-16 07:25:09.951197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.201 [2024-10-16 07:25:09.951231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.201 [2024-10-16 07:25:09.951248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.201 [2024-10-16 07:25:09.968185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.201 [2024-10-16 07:25:09.968219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:11668 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:09.968238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:09.985314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:09.985349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:24326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:09.985367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.002668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.002708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.002741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.014247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.014292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:21554 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.014314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.030541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.030579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:994 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.030598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.047527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.047564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.047584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.064640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.064676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:16603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.064696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.082882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.082913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:11605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.082930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.094190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.094223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.094246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.110581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.110615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.110633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.202 [2024-10-16 07:25:10.128316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.202 [2024-10-16 07:25:10.128350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.202 [2024-10-16 07:25:10.128370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.145776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.145819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:12967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.145835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.163645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.163679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.163698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.181797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.181826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:16217 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.181842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.197417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.197462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:15444 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.197480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.208997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.209055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.209073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.222824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.222851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:24258 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.222881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.234373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.234403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:12392 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.234420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.252831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.252859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.252889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.264414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.264447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:9483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.264465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.280422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.460 [2024-10-16 07:25:10.280451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:13099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.460 [2024-10-16 07:25:10.280488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.460 [2024-10-16 07:25:10.298510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.298543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:10483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.298562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.314299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.314333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:10007 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.314351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.325839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.325866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:15505 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.325898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.344341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.344373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12878 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.344392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.360901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.360944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.360960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.376769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.376815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6040 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.376831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.461 [2024-10-16 07:25:10.392677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.461 [2024-10-16 07:25:10.392711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:13611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.461 [2024-10-16 07:25:10.392738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.405389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.405422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:8631 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.405441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.422392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.422432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.422451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.434460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.434493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:11280 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.434512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.449147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.449175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:22507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.449207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.465464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.465499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9828 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.465518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.477723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.477763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:4172 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.477781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.495053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.495087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.495105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.509396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.509438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8146 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.509453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.526623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.526653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.526670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.538357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.538386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:17479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.538418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.556069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.556103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8492 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.556122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.573102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.573136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:18387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.573154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.719 [2024-10-16 07:25:10.590438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.719 [2024-10-16 07:25:10.590473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.719 [2024-10-16 07:25:10.590491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.720 [2024-10-16 07:25:10.605880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.720 [2024-10-16 07:25:10.605910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25133 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.720 [2024-10-16 07:25:10.605941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.720 [2024-10-16 07:25:10.617439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.720 [2024-10-16 07:25:10.617472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:25354 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.720 [2024-10-16 07:25:10.617491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.720 [2024-10-16 07:25:10.635260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.720 [2024-10-16 07:25:10.635305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.720 [2024-10-16 07:25:10.635324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.720 [2024-10-16 07:25:10.646841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.720 [2024-10-16 07:25:10.646871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.720 [2024-10-16 07:25:10.646888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.662809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.662837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:6680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.662868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.679334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.679369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:17237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.679393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.692660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.692693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:14228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.692712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.708804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.708835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:7641 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.708853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.723015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.723046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:19219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.723078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.735248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.735278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:25282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.735310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.751061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.751090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3815 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.751122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.768033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.768066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.768085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.785400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.785435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.785453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.801390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.801424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20087 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.801442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.817222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.817256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.817274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.828877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.828904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.828934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.845906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.845933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:16137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.845964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.861525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.861559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:4618 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.861578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.873548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.873582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:4077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.873601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.889806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.889849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:16275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.889865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.978 [2024-10-16 07:25:10.907045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:07.978 [2024-10-16 07:25:10.907079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5319 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.978 [2024-10-16 07:25:10.907097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:10.923967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:10.923997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:16768 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:10.924029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:10.939625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:10.939659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:20178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:10.939684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:10.951513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:10.951547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:10.951567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:10.969511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:10.969547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:7451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:10.969566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:10.986536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:10.986580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:10.986600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.003539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.003573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:2218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.003592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.020363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.020397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:7248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.020415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.037157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.037191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:15292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.037209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.054407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.054440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:22107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.054460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.071469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.071502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.071521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.088369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.088412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6745 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.088431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.105521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.105555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.105573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.123050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.123083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:25595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.123101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.138499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.138533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.138551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.149491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.149524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:8042 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.149543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.237 [2024-10-16 07:25:11.166544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.237 [2024-10-16 07:25:11.166578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.237 [2024-10-16 07:25:11.166596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.495 [2024-10-16 07:25:11.183643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.495 [2024-10-16 07:25:11.183677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.495 [2024-10-16 07:25:11.183696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.495 [2024-10-16 07:25:11.200920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.495 [2024-10-16 07:25:11.200948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.495 [2024-10-16 07:25:11.200978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.495 [2024-10-16 07:25:11.218057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.496 [2024-10-16 07:25:11.218091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.496 [2024-10-16 07:25:11.218109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.496 [2024-10-16 07:25:11.235113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.496 [2024-10-16 07:25:11.235147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:20164 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.496 [2024-10-16 07:25:11.235165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.496 [2024-10-16 07:25:11.251992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.496 [2024-10-16 07:25:11.252020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19579 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.496 [2024-10-16 07:25:11.252035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.496 [2024-10-16 07:25:11.268869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb15bb0) 00:27:08.496 [2024-10-16 07:25:11.268899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.496 [2024-10-16 07:25:11.268931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.496 00:27:08.496 Latency(us) 00:27:08.496 [2024-10-16T05:25:11.436Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.496 [2024-10-16T05:25:11.436Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:08.496 nvme0n1 : 2.01 16067.57 62.76 0.00 0.00 7959.93 3689.43 25631.86 00:27:08.496 [2024-10-16T05:25:11.436Z] =================================================================================================================== 00:27:08.496 [2024-10-16T05:25:11.436Z] Total : 16067.57 62.76 0.00 0.00 7959.93 3689.43 25631.86 00:27:08.496 0 00:27:08.496 07:25:11 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:08.496 07:25:11 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:08.496 07:25:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:08.496 07:25:11 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:08.496 | .driver_specific 00:27:08.496 | .nvme_error 00:27:08.496 | .status_code 00:27:08.496 | .command_transient_transport_error' 00:27:08.754 07:25:11 -- host/digest.sh@71 -- # (( 126 > 0 )) 00:27:08.754 07:25:11 -- host/digest.sh@73 -- # killprocess 2016172 00:27:08.754 07:25:11 -- common/autotest_common.sh@926 -- # '[' -z 2016172 ']' 00:27:08.754 07:25:11 -- common/autotest_common.sh@930 -- # kill -0 2016172 00:27:08.754 07:25:11 -- common/autotest_common.sh@931 -- # uname 00:27:08.754 07:25:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:08.754 07:25:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2016172 00:27:08.754 07:25:11 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:08.754 07:25:11 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:08.754 07:25:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2016172' 00:27:08.754 killing process with pid 2016172 00:27:08.754 07:25:11 -- common/autotest_common.sh@945 -- # kill 2016172 00:27:08.754 Received shutdown signal, test time was about 2.000000 seconds 00:27:08.754 00:27:08.754 Latency(us) 00:27:08.754 [2024-10-16T05:25:11.694Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.754 [2024-10-16T05:25:11.694Z] =================================================================================================================== 00:27:08.754 [2024-10-16T05:25:11.694Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:08.754 07:25:11 -- common/autotest_common.sh@950 -- # wait 2016172 00:27:09.012 07:25:11 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:09.012 07:25:11 -- host/digest.sh@54 -- # local rw bs qd 00:27:09.012 07:25:11 -- host/digest.sh@56 -- # rw=randread 00:27:09.012 07:25:11 -- host/digest.sh@56 -- # bs=131072 00:27:09.012 07:25:11 -- host/digest.sh@56 -- # qd=16 00:27:09.012 07:25:11 -- host/digest.sh@58 -- # bperfpid=2016733 00:27:09.012 07:25:11 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:09.012 07:25:11 -- host/digest.sh@60 -- # waitforlisten 2016733 /var/tmp/bperf.sock 00:27:09.012 07:25:11 -- common/autotest_common.sh@819 -- # '[' -z 2016733 ']' 00:27:09.012 07:25:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:09.012 07:25:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:09.012 07:25:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:09.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:09.012 07:25:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:09.012 07:25:11 -- common/autotest_common.sh@10 -- # set +x 00:27:09.012 [2024-10-16 07:25:11.898126] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:09.012 [2024-10-16 07:25:11.898208] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2016733 ] 00:27:09.012 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:09.012 Zero copy mechanism will not be used. 00:27:09.012 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.270 [2024-10-16 07:25:11.961809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:09.270 [2024-10-16 07:25:12.074201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:10.204 07:25:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:10.204 07:25:12 -- common/autotest_common.sh@852 -- # return 0 00:27:10.204 07:25:12 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.204 07:25:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.204 07:25:13 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.204 07:25:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.204 07:25:13 -- common/autotest_common.sh@10 -- # set +x 00:27:10.204 07:25:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.204 07:25:13 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.204 07:25:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.770 nvme0n1 00:27:10.770 07:25:13 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:10.770 07:25:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.770 07:25:13 -- common/autotest_common.sh@10 -- # set +x 00:27:10.770 07:25:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.770 07:25:13 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:10.770 07:25:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:10.770 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.770 Zero copy mechanism will not be used. 00:27:10.770 Running I/O for 2 seconds... 00:27:10.770 [2024-10-16 07:25:13.609651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.609718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.609760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.614429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.614461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.614497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.619331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.619362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.619380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.624224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.624254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.624270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.629331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.629362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.629378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.634893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.634926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.634944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.640292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.640322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.640339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.645362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.645391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.645408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.650211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.650240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.650256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.655150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.655180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.655196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.660718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.660786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.660806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.665866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.665897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.665915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.670643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.670674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.670691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.675096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.675127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.675144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.679558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.679589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.679606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.683795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.683826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.683843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.688844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.688875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.770 [2024-10-16 07:25:13.688893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.770 [2024-10-16 07:25:13.693352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.770 [2024-10-16 07:25:13.693381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.771 [2024-10-16 07:25:13.693398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.771 [2024-10-16 07:25:13.698691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.771 [2024-10-16 07:25:13.698722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.771 [2024-10-16 07:25:13.698763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.771 [2024-10-16 07:25:13.704086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.771 [2024-10-16 07:25:13.704116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.771 [2024-10-16 07:25:13.704133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.771 [2024-10-16 07:25:13.710374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:10.771 [2024-10-16 07:25:13.710405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.771 [2024-10-16 07:25:13.710422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.716724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.716764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.716782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.722785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.722817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.722834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.728847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.728878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.728896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.734785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.734816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.734834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.741012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.741044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.741061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.747093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.747126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.747144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.753392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.753431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.753449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.761978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.762009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.762027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.767903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.767934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.767951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.774454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.774484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.774501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.778320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.778351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.778368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.785051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.785081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.785098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.792557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.792586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.792617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.800331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.800363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.800380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.808410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.808441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.808475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.815024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.815069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.815086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.820457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.820489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.820507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.826029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.826060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.826078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.831430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.831462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.831480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.836400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.030 [2024-10-16 07:25:13.836446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.030 [2024-10-16 07:25:13.836463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.030 [2024-10-16 07:25:13.841659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.841691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.841707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.847031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.847075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.847092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.852680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.852734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.852780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.858527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.858575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.858599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.864307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.864339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.864356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.870245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.870277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.870295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.874488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.874519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.874536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.879147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.879178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.879195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.883818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.883848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.883865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.889138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.889169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.889186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.894263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.894293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.894309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.898854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.898884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.898901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.904399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.904435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.904453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.909897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.909928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.909945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.914568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.914599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.914616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.919917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.919948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.919965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.925681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.925712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.925738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.932021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.932068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.932085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.937580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.937625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.937642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.943499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.943530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.943547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.949475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.949506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.949539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.955519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.955564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.955581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.960150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.960181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.960198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.964754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.964784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.964801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.031 [2024-10-16 07:25:13.969264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.031 [2024-10-16 07:25:13.969296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.031 [2024-10-16 07:25:13.969313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.973946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.973977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.973994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.978592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.978623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.978640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.983100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.983131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.983148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.987410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.987441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.987458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.992027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.992057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.992081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:13.997393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:13.997424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:13.997441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:14.003173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:14.003205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:14.003222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:14.008539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:14.008570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:14.008587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:14.013626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:14.013657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.290 [2024-10-16 07:25:14.013673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.290 [2024-10-16 07:25:14.018830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.290 [2024-10-16 07:25:14.018862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.018879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.024410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.024454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.024470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.030124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.030154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.030171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.036118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.036149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.036166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.041843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.041880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.041899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.048043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.048075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.048092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.053581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.053613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.053631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.058593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.058624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.058643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.063029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.063060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.063077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.067831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.067860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.067877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.072671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.072701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.072717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.077550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.077579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.077595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.082303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.082332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.082356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.086627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.086656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.086673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.089629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.089657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.089673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.094594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.094623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.094640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.099397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.099425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.099440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.104296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.104325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.104342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.108222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.108251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.108269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.112504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.112534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.112550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.117599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.117628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.117645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.122642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.122677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.122693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.127673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.127702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.127718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.132640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.132670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.132686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.137689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.137719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.137744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.142567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.142596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.142612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.147332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.147361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.147377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.152101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.152129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.152144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.157052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.157080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.291 [2024-10-16 07:25:14.157097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.291 [2024-10-16 07:25:14.162053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.291 [2024-10-16 07:25:14.162082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.162099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.167408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.167455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.167472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.172112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.172140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.172156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.177256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.177286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.177302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.181238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.181268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.181285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.185637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.185667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.185683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.190263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.190293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.190309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.196281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.196327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.196343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.203664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.203712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.203737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.210344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.210375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.210399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.216337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.216382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.216398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.222266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.222310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.222327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.292 [2024-10-16 07:25:14.227895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.292 [2024-10-16 07:25:14.227925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.292 [2024-10-16 07:25:14.227943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.233884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.233915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.233932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.239200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.239231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.239247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.243744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.243774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.243791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.248040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.248070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.248086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.252975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.253003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.253019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.258032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.258086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.258103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.263076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.263119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.263135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.268054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.268082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.268097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.272929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.272957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.272973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.277889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.277918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.277935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.282857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.282886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.282902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.287725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.287760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.287776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.292552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.292580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.292596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.297146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.297175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.297206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.301846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.301875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.301891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.306857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.306885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.306901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.311513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.311544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.311560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.315885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.315914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.315930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.320761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.320790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.320807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.325769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.325798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.325814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.330390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.330420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.330436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.334578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.334607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.334624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.338669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.338699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.338723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.342850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.342878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.342894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.346280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.346308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.346324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.349980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.350009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.350024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.353887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.353916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.353932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.357698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.357734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.357752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.361660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.361690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.361707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.365694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.365722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.365748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.369347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.369375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.369392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.374051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.374085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.374102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.378905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.378934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.378950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.383796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.383824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.383840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.388294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.388323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.388339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.392968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.392997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.393014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.398062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.398092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.398108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.402997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.403026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.403042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.407948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.551 [2024-10-16 07:25:14.407977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.551 [2024-10-16 07:25:14.407993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.551 [2024-10-16 07:25:14.413072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.413102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.413118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.418264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.418294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.418310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.423255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.423284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.423316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.428354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.428383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.428400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.433296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.433325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.433342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.438402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.438431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.438447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.443450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.443480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.443496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.448502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.448532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.448548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.453531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.453560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.453576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.458409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.458437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.458460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.463440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.463469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.463486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.467435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.467464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.467480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.471459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.471489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.471505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.475500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.475531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.475547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.479719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.479760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.479778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.484571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.484600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.484616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.552 [2024-10-16 07:25:14.489385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.552 [2024-10-16 07:25:14.489414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.552 [2024-10-16 07:25:14.489431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.494141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.494171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.494187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.499220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.499252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.499269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.504426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.504456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.504473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.509578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.509613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.509632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.515074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.515108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.515127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.520598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.520632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.520651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.526163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.526196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.526214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.531408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.531441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.531460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.536782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.536811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.536828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.541881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.541911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.541934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.546944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.546974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.546990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.552140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.552173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.552191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.557588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.557620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.557638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.563089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.563122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.563141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.568949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.568981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.568999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.574680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.574713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.574741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.580391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.580425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.580443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.586242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.586277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.586297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.592548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.592588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.592609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.599001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.599032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.811 [2024-10-16 07:25:14.599049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.811 [2024-10-16 07:25:14.605069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.811 [2024-10-16 07:25:14.605104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.605122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.610242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.610275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.610294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.616192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.616226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.616244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.620965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.620995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.621011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.624159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.624189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.624205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.628847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.628877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.628894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.633955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.633984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.634000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.639152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.639185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.639204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.644427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.644460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.644478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.649469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.649501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.649520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.655302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.655334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.655352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.659582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.659614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.659632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.664567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.664599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.664616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.669717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.669775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.669792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.674752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.674794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.674810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.679808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.679837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.679874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.684810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.684839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.684856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.689826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.689855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.689871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.694958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.694994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.695010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.700160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.700199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.700216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.704709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.704757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.704800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.710003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.710057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.710072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.715256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.715288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.715307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.720234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.720264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.720283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.725197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.725235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.725253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.730451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.730482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.730500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.735634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.735665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.735684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.812 [2024-10-16 07:25:14.740865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.812 [2024-10-16 07:25:14.740908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.812 [2024-10-16 07:25:14.740923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.813 [2024-10-16 07:25:14.746106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.813 [2024-10-16 07:25:14.746138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.813 [2024-10-16 07:25:14.746155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.813 [2024-10-16 07:25:14.751079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:11.813 [2024-10-16 07:25:14.751112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.813 [2024-10-16 07:25:14.751130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.071 [2024-10-16 07:25:14.756099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.071 [2024-10-16 07:25:14.756131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.071 [2024-10-16 07:25:14.756149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.071 [2024-10-16 07:25:14.761173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.071 [2024-10-16 07:25:14.761204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.071 [2024-10-16 07:25:14.761222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.766484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.766517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.766535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.771670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.771705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.771723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.776508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.776546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.776563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.781580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.781612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.781630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.786646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.786678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.786696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.791682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.791715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.791742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.796891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.796920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.796937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.801945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.801975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.801992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.806429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.806461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.806480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.811118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.811156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.811176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.816065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.816110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.816128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.821146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.821178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.821195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.826178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.826210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.826228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.831170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.831202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.831220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.836307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.836339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.836357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.841430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.841461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.841479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.846487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.846518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.846536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.851474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.851505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.851523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.855816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.855846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.855862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.860176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.860206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.860223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.864142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.864172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.864189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.867886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.867915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.867932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.871568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.871597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.871613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.875512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.875542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.875560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.879624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.879654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.879670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.883577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.883607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.883623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.887692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.887724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.887763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.072 [2024-10-16 07:25:14.891792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.072 [2024-10-16 07:25:14.891821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.072 [2024-10-16 07:25:14.891837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.895981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.896025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.896044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.900678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.900710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.900735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.905651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.905684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.905702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.910719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.910774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.910791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.915923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.915951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.915984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.921041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.921089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.921108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.926354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.926386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.926404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.931215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.931253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.931273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.936053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.936084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.936103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.941409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.941440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.941458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.946665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.946697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.946715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.952067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.952101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.952120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.957464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.957496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.957514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.962620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.962652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.962669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.967925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.967956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.967972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.971882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.971911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.971928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.976083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.976115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.976133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.980535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.980568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.980586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.984845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.984874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.984890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.989105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.989137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.989155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.993333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.993365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.993383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:14.997640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:14.997672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:14.997689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:15.002224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:15.002258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:15.002276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:15.006953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:15.006999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:15.007014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.073 [2024-10-16 07:25:15.012181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.073 [2024-10-16 07:25:15.012212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.073 [2024-10-16 07:25:15.012234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.332 [2024-10-16 07:25:15.017583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.332 [2024-10-16 07:25:15.017613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.332 [2024-10-16 07:25:15.017630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.022719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.022758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.022777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.028078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.028110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.028129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.033457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.033489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.033508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.038635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.038667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.038686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.043909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.043955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.043972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.049252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.049286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.049305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.054512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.054547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.054566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.059807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.059838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.059854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.065021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.065049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.065081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.070724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.070780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.070797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.076261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.076296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.076314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.081667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.081700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.081718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.087005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.087035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.087067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.092106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.092138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.092156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.097087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.097120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.097139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.102940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.102984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.103006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.109879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.109910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.109927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.117267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.117301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.117321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.122474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.122507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.122527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.127776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.127807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.127824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.133123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.133154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.133171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.138512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.138546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.138565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.144338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.144373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.144392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.150203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.150238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.150258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.156272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.156313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.156332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.162175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.162210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.162229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.167781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.167812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.167829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.172428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.333 [2024-10-16 07:25:15.172458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.333 [2024-10-16 07:25:15.172475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.333 [2024-10-16 07:25:15.176241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.176270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.176287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.180057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.180085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.180102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.183753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.183780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.183797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.187594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.187622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.187639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.192205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.192233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.192249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.197357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.197386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.197402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.202190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.202219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.202236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.207323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.207352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.207369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.212208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.212237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.212254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.217108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.217137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.217153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.221917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.221946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.221962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.226810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.226840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.226856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.231799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.231827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.231844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.236972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.237001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.237024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.242115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.242145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.242161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.247414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.247448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.247466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.252434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.252467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.252485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.257451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.257483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.257501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.262460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.262492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.262510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.267349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.267381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.267400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.334 [2024-10-16 07:25:15.272125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.334 [2024-10-16 07:25:15.272158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.334 [2024-10-16 07:25:15.272176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.276408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.276440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.276458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.279466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.279501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.279535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.283921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.283951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.283967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.288349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.288382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.288400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.292867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.292896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.292912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.297002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.297046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.297065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.301151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.301182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.301200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.305301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.305332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.305351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.309298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.309330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.309348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.313184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.313216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.313234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.316906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.316934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.316951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.320308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.320340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.320358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.324240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.324272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.324289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.328181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.328212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.328231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.332229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.332262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.332279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.336026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.336071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.336089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.339992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.340038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.340055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.343850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.343878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.343894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.347669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.347700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.347725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.351575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.351607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.351624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.355454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.355485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.355503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.359365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.594 [2024-10-16 07:25:15.359395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.594 [2024-10-16 07:25:15.359413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.594 [2024-10-16 07:25:15.363190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.363222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.363240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.367279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.367311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.367329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.370678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.370709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.370736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.374638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.374669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.374687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.378534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.378563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.378579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.382712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.382748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.382766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.387302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.387344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.387360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.392233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.392265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.392282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.397323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.397355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.397373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.402359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.402391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.402409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.407432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.407464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.407482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.412216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.412250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.412269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.416925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.416954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.416971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.421173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.421205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.421229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.425569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.425602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.425620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.430866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.430896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.430913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.436721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.436762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.436781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.441950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.441980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.441997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.448254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.448288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.448307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.454238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.454273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.454292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.461952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.461983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.462001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.469591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.469626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.469645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.477168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.477209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.477229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.484875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.484905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.484938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.492574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.492608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.492628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.500461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.500495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.500514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.507548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.507583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.507603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.513704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.513743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.513762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.595 [2024-10-16 07:25:15.519918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.595 [2024-10-16 07:25:15.519951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.595 [2024-10-16 07:25:15.519968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.596 [2024-10-16 07:25:15.527088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.596 [2024-10-16 07:25:15.527124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.596 [2024-10-16 07:25:15.527144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.596 [2024-10-16 07:25:15.534750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.596 [2024-10-16 07:25:15.534800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.596 [2024-10-16 07:25:15.534817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.854 [2024-10-16 07:25:15.543209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.854 [2024-10-16 07:25:15.543244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.854 [2024-10-16 07:25:15.543263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.854 [2024-10-16 07:25:15.551865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.854 [2024-10-16 07:25:15.551896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.854 [2024-10-16 07:25:15.551913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.854 [2024-10-16 07:25:15.559411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.559446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.559466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.566722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.566766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.566785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.574120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.574155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.574175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.581857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.581892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.581911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.590013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.590045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.590077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.598377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.598412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.598430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.855 [2024-10-16 07:25:15.605773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1865bb0) 00:27:12.855 [2024-10-16 07:25:15.605819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.855 [2024-10-16 07:25:15.605843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.855 00:27:12.855 Latency(us) 00:27:12.855 [2024-10-16T05:25:15.795Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:12.855 [2024-10-16T05:25:15.795Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:12.855 nvme0n1 : 2.00 6045.08 755.64 0.00 0.00 2642.12 743.35 8980.86 00:27:12.855 [2024-10-16T05:25:15.795Z] =================================================================================================================== 00:27:12.855 [2024-10-16T05:25:15.795Z] Total : 6045.08 755.64 0.00 0.00 2642.12 743.35 8980.86 00:27:12.855 0 00:27:12.855 07:25:15 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:12.855 07:25:15 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:12.855 07:25:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:12.855 07:25:15 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:12.855 | .driver_specific 00:27:12.855 | .nvme_error 00:27:12.855 | .status_code 00:27:12.855 | .command_transient_transport_error' 00:27:13.113 07:25:15 -- host/digest.sh@71 -- # (( 390 > 0 )) 00:27:13.113 07:25:15 -- host/digest.sh@73 -- # killprocess 2016733 00:27:13.113 07:25:15 -- common/autotest_common.sh@926 -- # '[' -z 2016733 ']' 00:27:13.113 07:25:15 -- common/autotest_common.sh@930 -- # kill -0 2016733 00:27:13.113 07:25:15 -- common/autotest_common.sh@931 -- # uname 00:27:13.113 07:25:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:13.113 07:25:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2016733 00:27:13.113 07:25:15 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:13.113 07:25:15 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:13.113 07:25:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2016733' 00:27:13.113 killing process with pid 2016733 00:27:13.113 07:25:15 -- common/autotest_common.sh@945 -- # kill 2016733 00:27:13.113 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.113 00:27:13.113 Latency(us) 00:27:13.113 [2024-10-16T05:25:16.053Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.113 [2024-10-16T05:25:16.053Z] =================================================================================================================== 00:27:13.113 [2024-10-16T05:25:16.053Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.113 07:25:15 -- common/autotest_common.sh@950 -- # wait 2016733 00:27:13.371 07:25:16 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:13.371 07:25:16 -- host/digest.sh@54 -- # local rw bs qd 00:27:13.371 07:25:16 -- host/digest.sh@56 -- # rw=randwrite 00:27:13.371 07:25:16 -- host/digest.sh@56 -- # bs=4096 00:27:13.371 07:25:16 -- host/digest.sh@56 -- # qd=128 00:27:13.371 07:25:16 -- host/digest.sh@58 -- # bperfpid=2017278 00:27:13.371 07:25:16 -- host/digest.sh@60 -- # waitforlisten 2017278 /var/tmp/bperf.sock 00:27:13.371 07:25:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:13.371 07:25:16 -- common/autotest_common.sh@819 -- # '[' -z 2017278 ']' 00:27:13.371 07:25:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:13.371 07:25:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:13.371 07:25:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:13.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:13.371 07:25:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:13.371 07:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:13.371 [2024-10-16 07:25:16.215640] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:13.371 [2024-10-16 07:25:16.215744] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2017278 ] 00:27:13.371 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.371 [2024-10-16 07:25:16.277336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:13.630 [2024-10-16 07:25:16.388764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.562 07:25:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:14.562 07:25:17 -- common/autotest_common.sh@852 -- # return 0 00:27:14.562 07:25:17 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.562 07:25:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.819 07:25:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:14.819 07:25:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:14.819 07:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:14.819 07:25:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:14.819 07:25:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.819 07:25:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.077 nvme0n1 00:27:15.077 07:25:17 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:15.077 07:25:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:15.077 07:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:15.077 07:25:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:15.077 07:25:17 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:15.077 07:25:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:15.077 Running I/O for 2 seconds... 00:27:15.077 [2024-10-16 07:25:18.001053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.077 [2024-10-16 07:25:18.002499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:6323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.077 [2024-10-16 07:25:18.002543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.077 [2024-10-16 07:25:18.013835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ee5c8 00:27:15.077 [2024-10-16 07:25:18.015006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:8665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.077 [2024-10-16 07:25:18.015037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.025926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e3d08 00:27:15.335 [2024-10-16 07:25:18.027738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.027768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.037534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e38d0 00:27:15.335 [2024-10-16 07:25:18.038717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.038754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.049916] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.335 [2024-10-16 07:25:18.050865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:22792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.050906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.063370] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.335 [2024-10-16 07:25:18.064918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:2115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.064948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.075193] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ff3c8 00:27:15.335 [2024-10-16 07:25:18.075895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:23026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.075925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.087370] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ef270 00:27:15.335 [2024-10-16 07:25:18.089066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:12897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.089096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.100447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e9e10 00:27:15.335 [2024-10-16 07:25:18.102213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:8634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.102243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:15.335 [2024-10-16 07:25:18.111153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190feb58 00:27:15.335 [2024-10-16 07:25:18.112061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.335 [2024-10-16 07:25:18.112093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.123226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fbcf0 00:27:15.336 [2024-10-16 07:25:18.124597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.124630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.137137] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fcdd0 00:27:15.336 [2024-10-16 07:25:18.138013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:14855 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.138040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.149480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e6fa8 00:27:15.336 [2024-10-16 07:25:18.150341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.150368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.161602] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e8088 00:27:15.336 [2024-10-16 07:25:18.162412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.162441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.173620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ddc00 00:27:15.336 [2024-10-16 07:25:18.174449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.174479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.185682] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e1f80 00:27:15.336 [2024-10-16 07:25:18.187463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:3942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.187491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.197724] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.336 [2024-10-16 07:25:18.199480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:7206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.199513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.209791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e8088 00:27:15.336 [2024-10-16 07:25:18.211482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:16982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.211514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.221831] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e6738 00:27:15.336 [2024-10-16 07:25:18.223597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:14938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.223640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.234384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f2510 00:27:15.336 [2024-10-16 07:25:18.236023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:16910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.236073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.246571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ebfd0 00:27:15.336 [2024-10-16 07:25:18.248224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:18792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.248251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.258861] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f31b8 00:27:15.336 [2024-10-16 07:25:18.260549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.260592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:15.336 [2024-10-16 07:25:18.271112] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f2510 00:27:15.336 [2024-10-16 07:25:18.272796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.336 [2024-10-16 07:25:18.272823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.283305] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e1710 00:27:15.594 [2024-10-16 07:25:18.285018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:22403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.285064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.295480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190df988 00:27:15.594 [2024-10-16 07:25:18.296342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.296368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.305979] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e84c0 00:27:15.594 [2024-10-16 07:25:18.307228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:11843 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.307255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.318091] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ee5c8 00:27:15.594 [2024-10-16 07:25:18.319523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:12488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.319556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.329651] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fef90 00:27:15.594 [2024-10-16 07:25:18.330601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.330630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.341753] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ff3c8 00:27:15.594 [2024-10-16 07:25:18.342715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.342765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.353906] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e88f8 00:27:15.594 [2024-10-16 07:25:18.354897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.354939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.365692] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f2948 00:27:15.594 [2024-10-16 07:25:18.366690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:20565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.366744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.377876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc128 00:27:15.594 [2024-10-16 07:25:18.378893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:14978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.378919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.390165] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ea680 00:27:15.594 [2024-10-16 07:25:18.391207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:7380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.391236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.402705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190feb58 00:27:15.594 [2024-10-16 07:25:18.403389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:24670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.403420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.414741] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc560 00:27:15.594 [2024-10-16 07:25:18.415129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:23123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.594 [2024-10-16 07:25:18.415157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:15.594 [2024-10-16 07:25:18.426936] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ebb98 00:27:15.595 [2024-10-16 07:25:18.427290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:14018 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.427317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.439110] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fef90 00:27:15.595 [2024-10-16 07:25:18.439418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:3548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.439445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.453225] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190feb58 00:27:15.595 [2024-10-16 07:25:18.454978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:4050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.455020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.465572] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fef90 00:27:15.595 [2024-10-16 07:25:18.467370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:8697 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.467398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.478093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ddc00 00:27:15.595 [2024-10-16 07:25:18.479725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.479759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.490270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ff3c8 00:27:15.595 [2024-10-16 07:25:18.491932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:15472 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.491960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.502485] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e8d30 00:27:15.595 [2024-10-16 07:25:18.504170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:11570 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.504198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.514614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f5378 00:27:15.595 [2024-10-16 07:25:18.516282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:18154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.516326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:15.595 [2024-10-16 07:25:18.526576] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ecc78 00:27:15.595 [2024-10-16 07:25:18.528308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:13573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.595 [2024-10-16 07:25:18.528337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.537428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fef90 00:27:15.854 [2024-10-16 07:25:18.538420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:4779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.538453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.549990] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190df118 00:27:15.854 [2024-10-16 07:25:18.551314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12777 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.551342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.561653] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fda78 00:27:15.854 [2024-10-16 07:25:18.562921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:23356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.562950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.573968] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e6738 00:27:15.854 [2024-10-16 07:25:18.574835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:22365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.574877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.586167] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fe2e8 00:27:15.854 [2024-10-16 07:25:18.586781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:20509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.586822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.598276] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eee38 00:27:15.854 [2024-10-16 07:25:18.598861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.598886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.610354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.854 [2024-10-16 07:25:18.610834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:12662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.610861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.622507] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eaef0 00:27:15.854 [2024-10-16 07:25:18.622991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:16715 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.623019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.634501] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:15.854 [2024-10-16 07:25:18.634870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.634899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.646476] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eee38 00:27:15.854 [2024-10-16 07:25:18.646824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:21933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.646853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.658521] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fe2e8 00:27:15.854 [2024-10-16 07:25:18.658842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:17036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.658870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.670788] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f9b30 00:27:15.854 [2024-10-16 07:25:18.671085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:4047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.671124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.683005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e3060 00:27:15.854 [2024-10-16 07:25:18.683300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:21003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.683334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.694828] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e2c28 00:27:15.854 [2024-10-16 07:25:18.695103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:4157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.695131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.706913] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f46d0 00:27:15.854 [2024-10-16 07:25:18.707241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:22500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.707269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.721307] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e2c28 00:27:15.854 [2024-10-16 07:25:18.722277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.722304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.731797] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f3e60 00:27:15.854 [2024-10-16 07:25:18.733212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:10962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.733244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.743784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f3e60 00:27:15.854 [2024-10-16 07:25:18.745343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:1320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.745375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.754760] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f35f0 00:27:15.854 [2024-10-16 07:25:18.755964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:8531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.755993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.767285] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:15.854 [2024-10-16 07:25:18.768391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:20565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.768432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.779451] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eaef0 00:27:15.854 [2024-10-16 07:25:18.780544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:5987 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.780586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:15.854 [2024-10-16 07:25:18.791498] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb760 00:27:15.854 [2024-10-16 07:25:18.792618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:9865 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.854 [2024-10-16 07:25:18.792660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.803681] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e01f8 00:27:16.113 [2024-10-16 07:25:18.804803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:10016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.804833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.815676] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f2510 00:27:16.113 [2024-10-16 07:25:18.816813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:12297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.816841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.827551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e6fa8 00:27:16.113 [2024-10-16 07:25:18.828782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.828812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.840136] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fef90 00:27:16.113 [2024-10-16 07:25:18.840940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:9577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.840981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.852035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eee38 00:27:16.113 [2024-10-16 07:25:18.852529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:22527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.852570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.864186] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190df550 00:27:16.113 [2024-10-16 07:25:18.864650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:3002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.864676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.876343] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc560 00:27:16.113 [2024-10-16 07:25:18.876723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:24659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.876773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.888219] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e3498 00:27:16.113 [2024-10-16 07:25:18.888540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.888568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.899867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ddc00 00:27:16.113 [2024-10-16 07:25:18.900191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.900219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.911670] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e3060 00:27:16.113 [2024-10-16 07:25:18.912028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:5147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.912057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.923523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ff3c8 00:27:16.113 [2024-10-16 07:25:18.923876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:12410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.923905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.937569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ddc00 00:27:16.113 [2024-10-16 07:25:18.939366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:10873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.939410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.949447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e84c0 00:27:16.113 [2024-10-16 07:25:18.951240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:13818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.951268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.961309] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dece0 00:27:16.113 [2024-10-16 07:25:18.963101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.113 [2024-10-16 07:25:18.963129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:16.113 [2024-10-16 07:25:18.972002] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc128 00:27:16.114 [2024-10-16 07:25:18.973228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:9221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:18.973259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:18.984033] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc128 00:27:16.114 [2024-10-16 07:25:18.985431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:18285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:18.985464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:18.996281] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc128 00:27:16.114 [2024-10-16 07:25:18.997674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:1714 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:18.997705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:19.008367] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eaab8 00:27:16.114 [2024-10-16 07:25:19.009947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:24925 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:19.009975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:19.019301] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc560 00:27:16.114 [2024-10-16 07:25:19.020208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:8558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:19.020236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:19.031352] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190df118 00:27:16.114 [2024-10-16 07:25:19.031703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:17254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:19.031736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:16.114 [2024-10-16 07:25:19.043781] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.114 [2024-10-16 07:25:19.044827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:15794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.114 [2024-10-16 07:25:19.044855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.056065] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.057099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:24915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.057127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.068563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.069644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:19622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.069672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.080924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.082015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15389 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.082043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.093139] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.094287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:8160 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.094315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.105557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.106658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.106705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.117923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.119054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:12552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.119081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.130353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.131484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:11836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.131512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.142706] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.143832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:19601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.143860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.155098] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.156234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:3103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.156277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.167345] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.168511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:14178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.372 [2024-10-16 07:25:19.168539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:16.372 [2024-10-16 07:25:19.179621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.372 [2024-10-16 07:25:19.180815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:19292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.180841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.191774] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.192992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:8075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.193035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.204406] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.205619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:2983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.205663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.216841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.218058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:2034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.218102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.229221] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.230485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:12294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.230527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.241753] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.243013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.243056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.254234] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.255545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:18170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.255589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.266636] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.373 [2024-10-16 07:25:19.267882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:20581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.267910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.278346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fda78 00:27:16.373 [2024-10-16 07:25:19.278685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:4532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.278712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.290959] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.373 [2024-10-16 07:25:19.292039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:3489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.292067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:16.373 [2024-10-16 07:25:19.303394] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.373 [2024-10-16 07:25:19.304454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:13895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.373 [2024-10-16 07:25:19.304482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.315600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.316627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:2521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.316656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.328218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.329302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:6352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.329334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.340647] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.341695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.341747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.352978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.354115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:13232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.354143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.365466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.366579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.366606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.377713] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.378826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:24244 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.378854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.390031] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.391151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:4365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.391192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.402302] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.403457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:15687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.403484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.414588] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.415738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:16744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.415765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.426735] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.427848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.427899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.438985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.440149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:11094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.440177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.451275] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.452479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.452520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:16.661 [2024-10-16 07:25:19.463637] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.661 [2024-10-16 07:25:19.464832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.661 [2024-10-16 07:25:19.464859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.475846] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.662 [2024-10-16 07:25:19.477119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.477145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.488174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.662 [2024-10-16 07:25:19.489429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:1978 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.489455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.500574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.662 [2024-10-16 07:25:19.501854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:10485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.501881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.513071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190dfdc0 00:27:16.662 [2024-10-16 07:25:19.514358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:8270 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.514390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.524811] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e73e0 00:27:16.662 [2024-10-16 07:25:19.525129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.525155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.537298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e7818 00:27:16.662 [2024-10-16 07:25:19.538314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:12557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.538342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.549138] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eb328 00:27:16.662 [2024-10-16 07:25:19.550564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:18656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.550591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.560897] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190eea00 00:27:16.662 [2024-10-16 07:25:19.562301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:10191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.562334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.573204] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f2948 00:27:16.662 [2024-10-16 07:25:19.574651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:14805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.574695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.585778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f31b8 00:27:16.662 [2024-10-16 07:25:19.587088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:6805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.587130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:16.662 [2024-10-16 07:25:19.597852] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ff3c8 00:27:16.662 [2024-10-16 07:25:19.599116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:17565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.662 [2024-10-16 07:25:19.599143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.610073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e8088 00:27:16.920 [2024-10-16 07:25:19.611388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.611432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.622239] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e23b8 00:27:16.920 [2024-10-16 07:25:19.623580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:8874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.623608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.634160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fb8b8 00:27:16.920 [2024-10-16 07:25:19.635553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:2568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.635582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.646373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fdeb0 00:27:16.920 [2024-10-16 07:25:19.647336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:2032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.647367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.658556] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f35f0 00:27:16.920 [2024-10-16 07:25:19.659216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:11174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.659243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.670607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e2c28 00:27:16.920 [2024-10-16 07:25:19.671246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.671272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.682614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f3e60 00:27:16.920 [2024-10-16 07:25:19.683213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:12682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.683240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.694351] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc998 00:27:16.920 [2024-10-16 07:25:19.694897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:8842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.694925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.706007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f3e60 00:27:16.920 [2024-10-16 07:25:19.706537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:19910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.706565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.717515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e2c28 00:27:16.920 [2024-10-16 07:25:19.718056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:14318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.718084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.729607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f9f68 00:27:16.920 [2024-10-16 07:25:19.730114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:14771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.730143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.741415] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190f31b8 00:27:16.920 [2024-10-16 07:25:19.741941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:7692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.741978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.753154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fd208 00:27:16.920 [2024-10-16 07:25:19.753937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:24480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.753964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.764956] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fc998 00:27:16.920 [2024-10-16 07:25:19.766355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:18720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.766387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.776986] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190ea680 00:27:16.920 [2024-10-16 07:25:19.778329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.778375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.789172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e6300 00:27:16.920 [2024-10-16 07:25:19.790197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:13320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.790226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.801437] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190fb480 00:27:16.920 [2024-10-16 07:25:19.801847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:4786 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.801874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.814018] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:16.920 [2024-10-16 07:25:19.815132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.815159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.826307] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:16.920 [2024-10-16 07:25:19.827464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:2682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.827496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.839003] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:16.920 [2024-10-16 07:25:19.840142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:1023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.840170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:16.920 [2024-10-16 07:25:19.851416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:16.920 [2024-10-16 07:25:19.852560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:16873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.920 [2024-10-16 07:25:19.852588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.863672] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.864870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.864898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.876179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.877370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13939 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.877398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.888404] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.889599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:3428 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.889630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.900839] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.902094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.902122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.913226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.914467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.914494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.925649] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.926869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.926911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.937846] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.939092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.939119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.950096] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.951353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:7084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.951380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.962373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.963662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:1269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.963705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.974702] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.975980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:6974 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.976022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:17.179 [2024-10-16 07:25:19.986860] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64ad0) with pdu=0x2000190e99d8 00:27:17.179 [2024-10-16 07:25:19.988147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.179 [2024-10-16 07:25:19.988189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:17.179 00:27:17.179 Latency(us) 00:27:17.179 [2024-10-16T05:25:20.119Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.179 [2024-10-16T05:25:20.119Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:17.179 nvme0n1 : 2.00 20960.36 81.88 0.00 0.00 6098.87 2888.44 15049.01 00:27:17.179 [2024-10-16T05:25:20.119Z] =================================================================================================================== 00:27:17.179 [2024-10-16T05:25:20.119Z] Total : 20960.36 81.88 0.00 0.00 6098.87 2888.44 15049.01 00:27:17.179 0 00:27:17.179 07:25:20 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:17.179 07:25:20 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:17.179 07:25:20 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:17.179 | .driver_specific 00:27:17.179 | .nvme_error 00:27:17.179 | .status_code 00:27:17.179 | .command_transient_transport_error' 00:27:17.179 07:25:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:17.504 07:25:20 -- host/digest.sh@71 -- # (( 164 > 0 )) 00:27:17.504 07:25:20 -- host/digest.sh@73 -- # killprocess 2017278 00:27:17.504 07:25:20 -- common/autotest_common.sh@926 -- # '[' -z 2017278 ']' 00:27:17.504 07:25:20 -- common/autotest_common.sh@930 -- # kill -0 2017278 00:27:17.504 07:25:20 -- common/autotest_common.sh@931 -- # uname 00:27:17.504 07:25:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:17.504 07:25:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2017278 00:27:17.504 07:25:20 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:17.504 07:25:20 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:17.504 07:25:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2017278' 00:27:17.504 killing process with pid 2017278 00:27:17.504 07:25:20 -- common/autotest_common.sh@945 -- # kill 2017278 00:27:17.504 Received shutdown signal, test time was about 2.000000 seconds 00:27:17.504 00:27:17.504 Latency(us) 00:27:17.504 [2024-10-16T05:25:20.444Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.504 [2024-10-16T05:25:20.444Z] =================================================================================================================== 00:27:17.504 [2024-10-16T05:25:20.444Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:17.504 07:25:20 -- common/autotest_common.sh@950 -- # wait 2017278 00:27:17.761 07:25:20 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:17.761 07:25:20 -- host/digest.sh@54 -- # local rw bs qd 00:27:17.761 07:25:20 -- host/digest.sh@56 -- # rw=randwrite 00:27:17.761 07:25:20 -- host/digest.sh@56 -- # bs=131072 00:27:17.761 07:25:20 -- host/digest.sh@56 -- # qd=16 00:27:17.761 07:25:20 -- host/digest.sh@58 -- # bperfpid=2017827 00:27:17.762 07:25:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:17.762 07:25:20 -- host/digest.sh@60 -- # waitforlisten 2017827 /var/tmp/bperf.sock 00:27:17.762 07:25:20 -- common/autotest_common.sh@819 -- # '[' -z 2017827 ']' 00:27:17.762 07:25:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:17.762 07:25:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:17.762 07:25:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:17.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:17.762 07:25:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:17.762 07:25:20 -- common/autotest_common.sh@10 -- # set +x 00:27:17.762 [2024-10-16 07:25:20.633567] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:17.762 [2024-10-16 07:25:20.633649] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2017827 ] 00:27:17.762 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:17.762 Zero copy mechanism will not be used. 00:27:17.762 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.762 [2024-10-16 07:25:20.694176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.020 [2024-10-16 07:25:20.805865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:18.949 07:25:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:18.949 07:25:21 -- common/autotest_common.sh@852 -- # return 0 00:27:18.949 07:25:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:18.949 07:25:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:18.949 07:25:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:18.949 07:25:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:18.949 07:25:21 -- common/autotest_common.sh@10 -- # set +x 00:27:18.949 07:25:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:18.949 07:25:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:18.949 07:25:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.514 nvme0n1 00:27:19.514 07:25:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:19.514 07:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:19.514 07:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:19.514 07:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:19.514 07:25:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:19.514 07:25:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:19.514 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:19.514 Zero copy mechanism will not be used. 00:27:19.514 Running I/O for 2 seconds... 00:27:19.514 [2024-10-16 07:25:22.410375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.410779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.410823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.415797] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.415984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.416028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.420385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.420490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.420521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.426117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.426250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.426285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.430629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.430762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.430793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.435061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.435183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.435214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.439681] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.439839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.439874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.445320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.445635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.445672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.514 [2024-10-16 07:25:22.451544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.514 [2024-10-16 07:25:22.451819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.514 [2024-10-16 07:25:22.451850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.458138] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.458264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.458293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.464708] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.464950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.464980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.471159] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.471295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.471326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.477622] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.477819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.477864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.483447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.483661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.483693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.773 [2024-10-16 07:25:22.488881] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.773 [2024-10-16 07:25:22.489133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.773 [2024-10-16 07:25:22.489164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.494434] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.494677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.494723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.499657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.499829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.499862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.505085] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.505234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.505264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.510584] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.510759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.510789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.516000] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.516158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.516187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.521470] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.521614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.521643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.527096] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.527275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.527306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.532351] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.532590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.532620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.536701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.536906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.536936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.540952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.541131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.541161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.545527] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.545689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.545719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.549873] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.549998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.550027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.554133] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.554305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.554343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.558420] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.558605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.558636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.562807] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.562951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.562982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.567743] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.568082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.568112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.573030] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.573370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.573403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.579316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.579512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.579540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.584982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.585144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.585176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.590404] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.590582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.590612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.595996] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.596149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.596179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.601296] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.601481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.601510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.606792] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.607071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.607101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.612690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.612900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.612929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.618126] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.618285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.618314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.623530] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.623710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.623749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.629130] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.629296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.629326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.634396] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.634566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.774 [2024-10-16 07:25:22.634595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.774 [2024-10-16 07:25:22.640274] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.774 [2024-10-16 07:25:22.640471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.640500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.646302] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.646453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.646486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.652226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.652457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.652487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.657778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.657941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.657970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.663513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.663775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.663808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.669538] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.669715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.669755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.675152] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.675289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.675317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.680580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.680748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.680780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.686156] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.686331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.686360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.692170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.692303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.692332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.697848] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.698159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.698189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.703459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.703684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.703741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.775 [2024-10-16 07:25:22.709229] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:19.775 [2024-10-16 07:25:22.709447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.775 [2024-10-16 07:25:22.709476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.715469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.715671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.715701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.720969] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.721132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.721164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.726064] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.726231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.726265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.730941] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.731121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.731153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.735984] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.736262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.736292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.741175] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.035 [2024-10-16 07:25:22.741441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.035 [2024-10-16 07:25:22.741471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.035 [2024-10-16 07:25:22.746830] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.746988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.747019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.752685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.752921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.752952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.758220] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.758352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.758382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.763687] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.763834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.763863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.769044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.769258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.769288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.774571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.774705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.774743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.780443] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.780746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.780778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.786881] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.787132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.787162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.792480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.792633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.792668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.797901] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.798139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.798169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.802853] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.802978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.803008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.808016] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.808142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.808171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.813271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.813476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.813507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.817923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.818175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.818206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.823334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.823535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.823565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.828661] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.828812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.828842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.834712] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.834845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.834874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.840253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.840461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.840491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.845666] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.845812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.845843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.851037] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.851231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.851260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.856618] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.856941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.856971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.861926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.862102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.862135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.867447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.867715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.867756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.872995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.873143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.873173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.878137] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.878293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.878323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.883479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.883649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.883679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.888799] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.888963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.888992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.894287] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.894441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.894471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.036 [2024-10-16 07:25:22.899931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.036 [2024-10-16 07:25:22.900259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.036 [2024-10-16 07:25:22.900289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.905250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.905399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.905431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.910523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.910674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.910702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.915926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.916076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.916106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.921569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.921747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.921780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.927384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.927570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.927598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.932784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.932937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.932974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.938057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.938237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.938265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.943309] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.943458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.943486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.948557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.948693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.948722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.953931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.954110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.954139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.959390] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.959657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.959686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.964628] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.964814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.964845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.969088] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.969287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.969316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.037 [2024-10-16 07:25:22.973525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.037 [2024-10-16 07:25:22.973670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.037 [2024-10-16 07:25:22.973701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:22.978981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:22.979068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:22.979095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:22.983865] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:22.984055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:22.984086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:22.988118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:22.988268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:22.988298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:22.992126] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:22.992236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:22.992265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:22.996309] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:22.996506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:22.996537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.000364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.000554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.000583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.004551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.004775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.004809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.008679] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.008877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.008910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.012647] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.012755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.012785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.016815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.016988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.017020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.020948] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.021106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.021137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.025038] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.025149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.025179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.029259] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.029450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.029481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.033353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.033554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.033584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.037497] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.037716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.037754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.041529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.041701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.041739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.045578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.045695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.045725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.049778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.049965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.050000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.053812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.053926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.053955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.057957] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.058065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.058097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.062107] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.297 [2024-10-16 07:25:23.062304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.297 [2024-10-16 07:25:23.062333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.297 [2024-10-16 07:25:23.066253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.066430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.066459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.070412] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.070622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.070659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.074518] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.074668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.074697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.078655] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.078786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.078815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.082826] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.083000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.083029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.086898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.087028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.087066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.090993] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.091101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.091130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.095205] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.095395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.095427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.099333] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.099513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.099542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.103530] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.103752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.103781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.107606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.107774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.107808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.111678] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.111788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.111819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.115866] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.116027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.116057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.119954] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.120100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.120129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.123971] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.124074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.124104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.128182] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.128374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.128405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.132280] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.132472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.132500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.136475] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.136693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.136723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.140544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.140685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.140717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.144740] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.144880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.144908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.148955] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.149143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.149172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.153132] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.153253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.153282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.157241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.157347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.157383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.161469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.161661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.161690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.165542] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.165723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.165759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.169877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.170090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.170119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.174051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.174219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.174250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.178355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.178468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.178507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.182552] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.298 [2024-10-16 07:25:23.182810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.298 [2024-10-16 07:25:23.182850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.298 [2024-10-16 07:25:23.186835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.186947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.186977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.190953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.191075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.191104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.195163] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.195365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.195395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.199333] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.199516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.199545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.203482] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.203697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.203733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.207583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.207740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.207769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.211559] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.211670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.211699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.215720] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.215913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.215943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.220022] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.220133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.220161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.224134] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.224236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.224268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.228407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.228602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.228631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.232591] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.232775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.232804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.299 [2024-10-16 07:25:23.236714] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.299 [2024-10-16 07:25:23.236942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.299 [2024-10-16 07:25:23.236972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.240926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.241084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.241114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.244923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.245030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.245059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.249036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.249214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.249243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.253128] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.253257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.253287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.257139] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.257263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.257292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.261216] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.261408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.261437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.265330] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.265483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.265519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.269469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.269678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.269708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.273641] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.273810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.273839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.277773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.277883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.277911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.281918] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.282092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.282121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.286038] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.286143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.286172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.290174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.290299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.290328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.294318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.294513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.294543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.298404] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.298600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.559 [2024-10-16 07:25:23.298631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.559 [2024-10-16 07:25:23.302524] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.559 [2024-10-16 07:25:23.302752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.302782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.306877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.307061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.307092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.311761] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.311987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.312018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.317160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.317393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.317422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.323301] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.323457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.323487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.328263] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.328365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.328394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.332632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.332849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.332881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.337538] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.337635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.337664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.343175] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.343254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.343282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.347842] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.348003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.348034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.352430] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.352597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.352625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.357050] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.357221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.357250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.361454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.361590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.361624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.365863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.365990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.366019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.371160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.371447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.371476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.376646] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.376889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.376920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.382682] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.382891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.382921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.387244] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.387371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.387409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.391545] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.391673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.391704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.396548] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.396624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.396651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.401586] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.401692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.401722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.405747] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.405858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.405887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.409908] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.410104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.410135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.413989] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.414194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.414226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.418162] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.418376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.418407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.422316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.422493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.422522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.426539] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.426651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.426681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.430819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.431023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.431053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.435079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.435217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.560 [2024-10-16 07:25:23.435248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.560 [2024-10-16 07:25:23.439167] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.560 [2024-10-16 07:25:23.439277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.439310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.443296] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.443489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.443519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.447523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.447698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.447736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.451695] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.451926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.451956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.456202] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.456375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.456404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.460270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.460391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.460423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.464487] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.464687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.464720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.468650] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.468779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.468812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.472757] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.472875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.472907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.476861] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.477060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.477090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.480946] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.481103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.481132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.485130] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.485352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.485383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.489191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.489386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.489416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.493304] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.493418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.493450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.561 [2024-10-16 07:25:23.497443] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.561 [2024-10-16 07:25:23.497664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.561 [2024-10-16 07:25:23.497703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.501568] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.501682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.501712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.505678] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.505786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.505817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.509872] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.510042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.510071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.513914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.514096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.514131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.518015] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.518229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.518260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.522142] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.522307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.522337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.526201] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.526323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.526353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.821 [2024-10-16 07:25:23.530380] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.821 [2024-10-16 07:25:23.530566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.821 [2024-10-16 07:25:23.530596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.534559] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.534687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.534721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.538785] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.538883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.538912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.542980] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.543171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.543201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.547104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.547281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.547314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.551243] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.551455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.551487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.555316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.555489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.555518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.559364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.559476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.559505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.563511] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.563690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.563720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.567633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.567762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.567791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.571856] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.571958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.571987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.576030] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.576226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.576258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.580216] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.580361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.580391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.584408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.584623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.584652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.588514] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.588646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.588676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.592565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.592698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.592740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.596812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.596949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.596978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.601049] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.601204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.601237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.605269] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.605463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.605504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.609521] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.609772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.609802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.614472] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.614753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.614783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.619644] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.619921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.619951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.625589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.625848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.625879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.630477] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.630611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.630640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.635933] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.822 [2024-10-16 07:25:23.636078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.822 [2024-10-16 07:25:23.636112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.822 [2024-10-16 07:25:23.640973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.641157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.641190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.646076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.646176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.646205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.650325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.650442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.650472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.654703] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.654906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.654936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.660607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.660846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.660876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.664856] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.665028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.665060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.668943] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.669069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.669109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.673153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.673362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.673392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.677877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.678063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.678092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.683794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.683953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.683983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.688912] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.689218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.689248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.693800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.694058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.694088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.698382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.698660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.698690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.703414] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.703672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.703704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.708667] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.708868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.708898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.714025] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.714258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.714287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.718154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.718280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.718309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.722551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.722691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.722720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.726948] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.727143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.727172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.731362] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.731601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.731636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.735827] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.736046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.736076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.740061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.740259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.740288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.744652] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.744862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.744891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.749914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.750144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.750174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.755909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.756062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.756090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.823 [2024-10-16 07:25:23.761600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:20.823 [2024-10-16 07:25:23.761696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.823 [2024-10-16 07:25:23.761724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.767032] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.767173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.767201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.772322] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.772587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.772617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.777466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.777769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.777798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.783051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.783167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.783195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.789161] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.789317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.789346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.795283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.795386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.795413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.800762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.800853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.800880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.805854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.805979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.806022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.810630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.810848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.810879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.814698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.814882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.814914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.818997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.819216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.819247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.823245] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.823452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.823482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.827289] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.827412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.827441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.831488] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.831698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.831737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.835653] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.835823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.835854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.839639] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.839764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.839794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.843825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.844024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.844053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.848025] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.848240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.848268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.852398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.852608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.852637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.856491] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.856674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.856710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.860551] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.860665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.860700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.864796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.864958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.864986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.868850] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.084 [2024-10-16 07:25:23.868986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.084 [2024-10-16 07:25:23.869017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.084 [2024-10-16 07:25:23.872939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.873052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.873081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.877211] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.877403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.877432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.881239] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.881416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.881445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.885384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.885592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.885621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.889437] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.889577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.889606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.893557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.893692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.893720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.897655] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.897863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.897893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.901838] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.901969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.901997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.905891] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.906005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.906033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.910069] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.910250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.910279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.914256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.914387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.914416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.918365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.918560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.918590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.922471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.922647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.922676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.926606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.926785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.926813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.930937] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.931129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.931158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.935114] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.935226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.935255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.939326] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.939497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.939526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.943503] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.943701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.943740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.947544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.947696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.947724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.951764] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.951946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.951975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.955951] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.956108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.956139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.960082] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.960208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.960237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.964238] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.964432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.964461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.968371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.968504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.085 [2024-10-16 07:25:23.968534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.085 [2024-10-16 07:25:23.972448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.085 [2024-10-16 07:25:23.972642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:23.972671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:23.977388] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:23.977608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:23.977637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:23.982539] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:23.982763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:23.982792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:23.988796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:23.989017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:23.989046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:23.994523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:23.994686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:23.994714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:24.000135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:24.000273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:24.000302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:24.005784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:24.005985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:24.006014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:24.011253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:24.011469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:24.011500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:24.016636] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:24.016795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:24.016825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.086 [2024-10-16 07:25:24.022111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.086 [2024-10-16 07:25:24.022272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.086 [2024-10-16 07:25:24.022301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.027500] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.027784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.027815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.033097] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.033412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.033442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.038448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.038676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.038707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.043656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.043851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.043880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.049061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.049247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.049275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.054445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.054688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.054723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.059982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.060145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.060177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.065536] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.065847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.065876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.070094] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.070341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.070370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.075391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.075603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.075631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.081614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.081785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.345 [2024-10-16 07:25:24.081814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.345 [2024-10-16 07:25:24.087219] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.345 [2024-10-16 07:25:24.087417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.087446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.091867] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.091996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.092025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.096163] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.096368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.096397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.100435] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.100598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.100627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.104764] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.104978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.105007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.108876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.109042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.109072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.113177] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.113357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.113390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.117869] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.118046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.118075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.123101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.123253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.123285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.127778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.127939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.127968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.133505] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.133677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.133706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.139044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.139326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.139355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.144355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.144644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.144676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.150149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.150348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.150380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.155760] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.155886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.155915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.161141] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.161336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.161366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.166452] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.166765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.166795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.171934] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.172126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.172154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.178665] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.178972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.179001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.184235] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.184395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.184424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.190123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.190297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.190330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.195898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.196099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.196131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.201298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.201494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.201522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.206879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.207072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.207100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.212453] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.212709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.212747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.217859] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.218005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.346 [2024-10-16 07:25:24.218034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.346 [2024-10-16 07:25:24.223226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.346 [2024-10-16 07:25:24.223347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.223376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.228876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.229104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.229133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.234411] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.234620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.234652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.239849] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.239989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.240017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.245425] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.245629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.245657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.251058] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.251329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.251358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.256267] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.256494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.256523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.261895] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.262161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.262190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.267024] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.267253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.267285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.272050] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.272274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.272305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.276571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.276763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.276793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.281330] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.281503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.281532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.347 [2024-10-16 07:25:24.286664] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.347 [2024-10-16 07:25:24.286780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.347 [2024-10-16 07:25:24.286810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.292179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.292412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.292441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.297307] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.297443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.297472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.302451] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.302745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.302774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.307504] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.307689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.307719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.312365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.312521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.312551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.318211] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.318462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.318491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.605 [2024-10-16 07:25:24.323790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.605 [2024-10-16 07:25:24.323943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.605 [2024-10-16 07:25:24.323972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.328263] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.328460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.328495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.332679] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.332830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.332860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.337974] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.338070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.338097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.342722] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.342937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.342968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.346758] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.346945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.346974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.350997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.351217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.351249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.355070] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.355246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.355276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.359117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.359243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.359272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.363207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.363387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.363417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.367373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.367562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.367591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.371582] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.371692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.371721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.375824] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.376036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.376065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.379988] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.380151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.380179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.384178] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.384438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.384468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.388332] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.388517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.388561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.392510] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.392649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.392692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.396641] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.396871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.396901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.606 [2024-10-16 07:25:24.400796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e64fb0) with pdu=0x2000190fef90 00:27:21.606 [2024-10-16 07:25:24.400924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.606 [2024-10-16 07:25:24.400957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.606 00:27:21.606 Latency(us) 00:27:21.606 [2024-10-16T05:25:24.546Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.606 [2024-10-16T05:25:24.546Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:21.606 nvme0n1 : 2.00 6469.46 808.68 0.00 0.00 2466.21 1771.90 10145.94 00:27:21.606 [2024-10-16T05:25:24.546Z] =================================================================================================================== 00:27:21.606 [2024-10-16T05:25:24.546Z] Total : 6469.46 808.68 0.00 0.00 2466.21 1771.90 10145.94 00:27:21.606 0 00:27:21.606 07:25:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:21.606 07:25:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:21.606 07:25:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:21.606 | .driver_specific 00:27:21.606 | .nvme_error 00:27:21.606 | .status_code 00:27:21.606 | .command_transient_transport_error' 00:27:21.606 07:25:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:21.864 07:25:24 -- host/digest.sh@71 -- # (( 417 > 0 )) 00:27:21.864 07:25:24 -- host/digest.sh@73 -- # killprocess 2017827 00:27:21.864 07:25:24 -- common/autotest_common.sh@926 -- # '[' -z 2017827 ']' 00:27:21.864 07:25:24 -- common/autotest_common.sh@930 -- # kill -0 2017827 00:27:21.864 07:25:24 -- common/autotest_common.sh@931 -- # uname 00:27:21.864 07:25:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:21.864 07:25:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2017827 00:27:21.864 07:25:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:21.864 07:25:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:21.864 07:25:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2017827' 00:27:21.864 killing process with pid 2017827 00:27:21.864 07:25:24 -- common/autotest_common.sh@945 -- # kill 2017827 00:27:21.864 Received shutdown signal, test time was about 2.000000 seconds 00:27:21.864 00:27:21.864 Latency(us) 00:27:21.864 [2024-10-16T05:25:24.804Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.864 [2024-10-16T05:25:24.804Z] =================================================================================================================== 00:27:21.864 [2024-10-16T05:25:24.804Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:21.864 07:25:24 -- common/autotest_common.sh@950 -- # wait 2017827 00:27:22.123 07:25:24 -- host/digest.sh@115 -- # killprocess 2016148 00:27:22.123 07:25:24 -- common/autotest_common.sh@926 -- # '[' -z 2016148 ']' 00:27:22.123 07:25:24 -- common/autotest_common.sh@930 -- # kill -0 2016148 00:27:22.123 07:25:24 -- common/autotest_common.sh@931 -- # uname 00:27:22.123 07:25:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:22.123 07:25:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2016148 00:27:22.123 07:25:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:22.123 07:25:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:22.123 07:25:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2016148' 00:27:22.123 killing process with pid 2016148 00:27:22.123 07:25:25 -- common/autotest_common.sh@945 -- # kill 2016148 00:27:22.123 07:25:25 -- common/autotest_common.sh@950 -- # wait 2016148 00:27:22.381 00:27:22.381 real 0m18.223s 00:27:22.381 user 0m36.935s 00:27:22.381 sys 0m4.517s 00:27:22.381 07:25:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:22.381 07:25:25 -- common/autotest_common.sh@10 -- # set +x 00:27:22.381 ************************************ 00:27:22.381 END TEST nvmf_digest_error 00:27:22.381 ************************************ 00:27:22.381 07:25:25 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:22.381 07:25:25 -- host/digest.sh@139 -- # nvmftestfini 00:27:22.381 07:25:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:22.381 07:25:25 -- nvmf/common.sh@116 -- # sync 00:27:22.381 07:25:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:22.381 07:25:25 -- nvmf/common.sh@119 -- # set +e 00:27:22.381 07:25:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:22.381 07:25:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:22.381 rmmod nvme_tcp 00:27:22.639 rmmod nvme_fabrics 00:27:22.639 rmmod nvme_keyring 00:27:22.639 07:25:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:22.639 07:25:25 -- nvmf/common.sh@123 -- # set -e 00:27:22.639 07:25:25 -- nvmf/common.sh@124 -- # return 0 00:27:22.639 07:25:25 -- nvmf/common.sh@477 -- # '[' -n 2016148 ']' 00:27:22.639 07:25:25 -- nvmf/common.sh@478 -- # killprocess 2016148 00:27:22.639 07:25:25 -- common/autotest_common.sh@926 -- # '[' -z 2016148 ']' 00:27:22.639 07:25:25 -- common/autotest_common.sh@930 -- # kill -0 2016148 00:27:22.639 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2016148) - No such process 00:27:22.639 07:25:25 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2016148 is not found' 00:27:22.639 Process with pid 2016148 is not found 00:27:22.639 07:25:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:22.639 07:25:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:22.639 07:25:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:22.639 07:25:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:22.639 07:25:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:22.639 07:25:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:22.639 07:25:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:22.639 07:25:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:24.539 07:25:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:24.539 00:27:24.539 real 0m38.176s 00:27:24.539 user 1m8.802s 00:27:24.539 sys 0m10.291s 00:27:24.539 07:25:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:24.539 07:25:27 -- common/autotest_common.sh@10 -- # set +x 00:27:24.539 ************************************ 00:27:24.539 END TEST nvmf_digest 00:27:24.539 ************************************ 00:27:24.539 07:25:27 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:24.539 07:25:27 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:24.539 07:25:27 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:24.539 07:25:27 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:24.539 07:25:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:24.539 07:25:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:24.539 07:25:27 -- common/autotest_common.sh@10 -- # set +x 00:27:24.539 ************************************ 00:27:24.539 START TEST nvmf_bdevperf 00:27:24.539 ************************************ 00:27:24.540 07:25:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:24.799 * Looking for test storage... 00:27:24.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:24.799 07:25:27 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:24.799 07:25:27 -- nvmf/common.sh@7 -- # uname -s 00:27:24.799 07:25:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:24.799 07:25:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:24.799 07:25:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:24.799 07:25:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:24.799 07:25:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:24.799 07:25:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:24.799 07:25:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:24.799 07:25:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:24.799 07:25:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:24.799 07:25:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:24.799 07:25:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:24.799 07:25:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:24.799 07:25:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:24.799 07:25:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:24.799 07:25:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:24.799 07:25:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:24.799 07:25:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:24.799 07:25:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:24.799 07:25:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:24.799 07:25:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.799 07:25:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.799 07:25:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.799 07:25:27 -- paths/export.sh@5 -- # export PATH 00:27:24.799 07:25:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.799 07:25:27 -- nvmf/common.sh@46 -- # : 0 00:27:24.799 07:25:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:24.799 07:25:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:24.799 07:25:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:24.799 07:25:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:24.799 07:25:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:24.799 07:25:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:24.799 07:25:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:24.799 07:25:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:24.799 07:25:27 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:24.799 07:25:27 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:24.799 07:25:27 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:24.799 07:25:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:24.799 07:25:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:24.799 07:25:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:24.799 07:25:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:24.799 07:25:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:24.799 07:25:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:24.799 07:25:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:24.799 07:25:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:24.799 07:25:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:24.799 07:25:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:24.799 07:25:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:24.799 07:25:27 -- common/autotest_common.sh@10 -- # set +x 00:27:26.792 07:25:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:26.792 07:25:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:26.792 07:25:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:26.792 07:25:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:26.792 07:25:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:26.792 07:25:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:26.792 07:25:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:26.792 07:25:29 -- nvmf/common.sh@294 -- # net_devs=() 00:27:26.792 07:25:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:26.792 07:25:29 -- nvmf/common.sh@295 -- # e810=() 00:27:26.792 07:25:29 -- nvmf/common.sh@295 -- # local -ga e810 00:27:26.792 07:25:29 -- nvmf/common.sh@296 -- # x722=() 00:27:26.792 07:25:29 -- nvmf/common.sh@296 -- # local -ga x722 00:27:26.792 07:25:29 -- nvmf/common.sh@297 -- # mlx=() 00:27:26.792 07:25:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:26.792 07:25:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:26.792 07:25:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:26.792 07:25:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:26.792 07:25:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:26.792 07:25:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:26.792 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:26.792 07:25:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:26.792 07:25:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:26.792 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:26.792 07:25:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:26.792 07:25:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:26.792 07:25:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:26.792 07:25:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:26.792 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:26.792 07:25:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:26.792 07:25:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:26.792 07:25:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:26.792 07:25:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:26.792 07:25:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:26.792 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:26.792 07:25:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:26.792 07:25:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:26.792 07:25:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:26.792 07:25:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:26.792 07:25:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:26.792 07:25:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:26.792 07:25:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:26.792 07:25:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:26.792 07:25:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:26.792 07:25:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:26.792 07:25:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:26.792 07:25:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:26.793 07:25:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:26.793 07:25:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:26.793 07:25:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:26.793 07:25:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:26.793 07:25:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:26.793 07:25:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:26.793 07:25:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:26.793 07:25:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:26.793 07:25:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:26.793 07:25:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:26.793 07:25:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:26.793 07:25:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:26.793 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:26.793 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:27:26.793 00:27:26.793 --- 10.0.0.2 ping statistics --- 00:27:26.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:26.793 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:27:26.793 07:25:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:26.793 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:26.793 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:27:26.793 00:27:26.793 --- 10.0.0.1 ping statistics --- 00:27:26.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:26.793 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:27:26.793 07:25:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:26.793 07:25:29 -- nvmf/common.sh@410 -- # return 0 00:27:26.793 07:25:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:26.793 07:25:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:26.793 07:25:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:26.793 07:25:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:26.793 07:25:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:26.793 07:25:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:26.793 07:25:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:26.793 07:25:29 -- host/bdevperf.sh@25 -- # tgt_init 00:27:26.793 07:25:29 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:26.793 07:25:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:26.793 07:25:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:26.793 07:25:29 -- common/autotest_common.sh@10 -- # set +x 00:27:26.793 07:25:29 -- nvmf/common.sh@469 -- # nvmfpid=2020335 00:27:26.793 07:25:29 -- nvmf/common.sh@470 -- # waitforlisten 2020335 00:27:26.793 07:25:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:26.793 07:25:29 -- common/autotest_common.sh@819 -- # '[' -z 2020335 ']' 00:27:26.793 07:25:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:26.793 07:25:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:26.793 07:25:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:26.793 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:26.793 07:25:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:26.793 07:25:29 -- common/autotest_common.sh@10 -- # set +x 00:27:27.050 [2024-10-16 07:25:29.759079] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:27.050 [2024-10-16 07:25:29.759166] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:27.050 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.050 [2024-10-16 07:25:29.826023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:27.050 [2024-10-16 07:25:29.941913] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.050 [2024-10-16 07:25:29.942103] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.050 [2024-10-16 07:25:29.942123] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.050 [2024-10-16 07:25:29.942138] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.050 [2024-10-16 07:25:29.942249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:27.050 [2024-10-16 07:25:29.942310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.050 [2024-10-16 07:25:29.942313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:27.983 07:25:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:27.983 07:25:30 -- common/autotest_common.sh@852 -- # return 0 00:27:27.983 07:25:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:27.983 07:25:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 07:25:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:27.983 07:25:30 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:27.983 07:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 [2024-10-16 07:25:30.730928] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:27.983 07:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:27.983 07:25:30 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:27.983 07:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 Malloc0 00:27:27.983 07:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:27.983 07:25:30 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:27.983 07:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 07:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:27.983 07:25:30 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:27.983 07:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 07:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:27.983 07:25:30 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:27.983 07:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:27.983 07:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:27.983 [2024-10-16 07:25:30.793671] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:27.983 07:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:27.983 07:25:30 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:27.983 07:25:30 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:27.983 07:25:30 -- nvmf/common.sh@520 -- # config=() 00:27:27.983 07:25:30 -- nvmf/common.sh@520 -- # local subsystem config 00:27:27.983 07:25:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:27.983 07:25:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:27.983 { 00:27:27.983 "params": { 00:27:27.983 "name": "Nvme$subsystem", 00:27:27.983 "trtype": "$TEST_TRANSPORT", 00:27:27.983 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:27.983 "adrfam": "ipv4", 00:27:27.983 "trsvcid": "$NVMF_PORT", 00:27:27.983 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:27.983 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:27.983 "hdgst": ${hdgst:-false}, 00:27:27.983 "ddgst": ${ddgst:-false} 00:27:27.983 }, 00:27:27.983 "method": "bdev_nvme_attach_controller" 00:27:27.983 } 00:27:27.984 EOF 00:27:27.984 )") 00:27:27.984 07:25:30 -- nvmf/common.sh@542 -- # cat 00:27:27.984 07:25:30 -- nvmf/common.sh@544 -- # jq . 00:27:27.984 07:25:30 -- nvmf/common.sh@545 -- # IFS=, 00:27:27.984 07:25:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:27.984 "params": { 00:27:27.984 "name": "Nvme1", 00:27:27.984 "trtype": "tcp", 00:27:27.984 "traddr": "10.0.0.2", 00:27:27.984 "adrfam": "ipv4", 00:27:27.984 "trsvcid": "4420", 00:27:27.984 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:27.984 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:27.984 "hdgst": false, 00:27:27.984 "ddgst": false 00:27:27.984 }, 00:27:27.984 "method": "bdev_nvme_attach_controller" 00:27:27.984 }' 00:27:27.984 [2024-10-16 07:25:30.834163] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:27.984 [2024-10-16 07:25:30.834245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2020494 ] 00:27:27.984 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.984 [2024-10-16 07:25:30.892132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:28.242 [2024-10-16 07:25:30.999512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:28.500 Running I/O for 1 seconds... 00:27:29.433 00:27:29.433 Latency(us) 00:27:29.433 [2024-10-16T05:25:32.373Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:29.433 [2024-10-16T05:25:32.373Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:29.433 Verification LBA range: start 0x0 length 0x4000 00:27:29.433 Nvme1n1 : 1.01 12867.43 50.26 0.00 0.00 9902.82 1662.67 15243.19 00:27:29.433 [2024-10-16T05:25:32.373Z] =================================================================================================================== 00:27:29.433 [2024-10-16T05:25:32.373Z] Total : 12867.43 50.26 0.00 0.00 9902.82 1662.67 15243.19 00:27:29.692 07:25:32 -- host/bdevperf.sh@30 -- # bdevperfpid=2020648 00:27:29.692 07:25:32 -- host/bdevperf.sh@32 -- # sleep 3 00:27:29.692 07:25:32 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:29.692 07:25:32 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:29.692 07:25:32 -- nvmf/common.sh@520 -- # config=() 00:27:29.692 07:25:32 -- nvmf/common.sh@520 -- # local subsystem config 00:27:29.692 07:25:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:29.692 07:25:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:29.692 { 00:27:29.692 "params": { 00:27:29.692 "name": "Nvme$subsystem", 00:27:29.692 "trtype": "$TEST_TRANSPORT", 00:27:29.692 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:29.692 "adrfam": "ipv4", 00:27:29.692 "trsvcid": "$NVMF_PORT", 00:27:29.692 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:29.692 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:29.692 "hdgst": ${hdgst:-false}, 00:27:29.692 "ddgst": ${ddgst:-false} 00:27:29.692 }, 00:27:29.692 "method": "bdev_nvme_attach_controller" 00:27:29.692 } 00:27:29.692 EOF 00:27:29.692 )") 00:27:29.692 07:25:32 -- nvmf/common.sh@542 -- # cat 00:27:29.692 07:25:32 -- nvmf/common.sh@544 -- # jq . 00:27:29.692 07:25:32 -- nvmf/common.sh@545 -- # IFS=, 00:27:29.692 07:25:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:29.692 "params": { 00:27:29.692 "name": "Nvme1", 00:27:29.692 "trtype": "tcp", 00:27:29.692 "traddr": "10.0.0.2", 00:27:29.692 "adrfam": "ipv4", 00:27:29.692 "trsvcid": "4420", 00:27:29.692 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:29.692 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:29.692 "hdgst": false, 00:27:29.692 "ddgst": false 00:27:29.692 }, 00:27:29.692 "method": "bdev_nvme_attach_controller" 00:27:29.692 }' 00:27:29.692 [2024-10-16 07:25:32.621826] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:29.692 [2024-10-16 07:25:32.621909] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2020648 ] 00:27:29.950 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.950 [2024-10-16 07:25:32.680476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:29.950 [2024-10-16 07:25:32.784539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:30.208 Running I/O for 15 seconds... 00:27:32.740 07:25:35 -- host/bdevperf.sh@33 -- # kill -9 2020335 00:27:32.740 07:25:35 -- host/bdevperf.sh@35 -- # sleep 3 00:27:32.740 [2024-10-16 07:25:35.599150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:6376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:6856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:6888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:6912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.599980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.599995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:7048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:7056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:7064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:7072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:6504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:6528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.740 [2024-10-16 07:25:35.600516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.740 [2024-10-16 07:25:35.600531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:7088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:7096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:7104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:6712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:7112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.600975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.600991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:7136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:7144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:7152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:7168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:7176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:7192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:7200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:7216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:7240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:7248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:7264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:7272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:7288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.741 [2024-10-16 07:25:35.601639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:7296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:6720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.741 [2024-10-16 07:25:35.601871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.741 [2024-10-16 07:25:35.601884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.601899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.601911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.601927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.601941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.601956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:7304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.601969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.601984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:7312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.601998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:7320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:7328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:7360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:7368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:7376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:7384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:7392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:7408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:7416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:6832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:6840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:6864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:7424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:7448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.602821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:7456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:7464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:7480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:7488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.602973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.602988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:7496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.603001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:7504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.603053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:7512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.603084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:7520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.603115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:7528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:32.742 [2024-10-16 07:25:35.603145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:6952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.603175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.603206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.742 [2024-10-16 07:25:35.603236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.742 [2024-10-16 07:25:35.603252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:6992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.743 [2024-10-16 07:25:35.603267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.743 [2024-10-16 07:25:35.603283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:7032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.743 [2024-10-16 07:25:35.603297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.743 [2024-10-16 07:25:35.603314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:7040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.743 [2024-10-16 07:25:35.603328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.743 [2024-10-16 07:25:35.603344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:32.743 [2024-10-16 07:25:35.603358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.743 [2024-10-16 07:25:35.603374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbcf740 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.603392] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:32.743 [2024-10-16 07:25:35.603404] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:32.743 [2024-10-16 07:25:35.603417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7128 len:8 PRP1 0x0 PRP2 0x0 00:27:32.743 [2024-10-16 07:25:35.603435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:32.743 [2024-10-16 07:25:35.603513] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xbcf740 was disconnected and freed. reset controller. 00:27:32.743 [2024-10-16 07:25:35.606058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.606133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.606808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.606959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.606988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.607006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.607155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.607342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.607365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.607384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.609982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.743 [2024-10-16 07:25:35.618808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.619111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.619277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.619306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.619324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.619489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.619641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.619664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.619679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.622004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.743 [2024-10-16 07:25:35.631188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.631537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.631674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.631703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.631721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.631880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.632104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.632128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.632150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.634607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.743 [2024-10-16 07:25:35.643871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.644232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.644449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.644501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.644518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.644647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.644829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.644854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.644869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.647202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.743 [2024-10-16 07:25:35.656411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.656739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.656919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.656945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.656961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.657157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.657359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.657382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.657397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.659565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.743 [2024-10-16 07:25:35.669077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.743 [2024-10-16 07:25:35.669357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.669520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.743 [2024-10-16 07:25:35.669550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:32.743 [2024-10-16 07:25:35.669567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:32.743 [2024-10-16 07:25:35.669696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:32.743 [2024-10-16 07:25:35.669859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.743 [2024-10-16 07:25:35.669884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.743 [2024-10-16 07:25:35.669899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.743 [2024-10-16 07:25:35.672091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.681690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.682032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.682191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.682217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.682232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.682393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.682521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.682545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.682560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.685112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.694273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.694553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.694652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.694680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.694698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.694854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.695005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.695028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.695043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.697440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.706869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.707142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.707282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.707310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.707328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.707510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.707696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.707720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.707748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.709897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.719278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.719610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.719746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.719776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.719793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.719922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.720054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.720077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.720092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.722342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.731857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.732210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.732344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.732373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.732391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.732538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.732671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.732694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.732709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.735010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.744464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.744818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.744946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.744972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.744998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.745189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.745376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.745399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.745415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.003 [2024-10-16 07:25:35.747841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.003 [2024-10-16 07:25:35.756860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.003 [2024-10-16 07:25:35.757160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.757333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.003 [2024-10-16 07:25:35.757361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.003 [2024-10-16 07:25:35.757379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.003 [2024-10-16 07:25:35.757562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.003 [2024-10-16 07:25:35.757758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.003 [2024-10-16 07:25:35.757783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.003 [2024-10-16 07:25:35.757799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.760037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.769632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.769962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.770092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.770121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.770138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.770356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.770525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.770548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.770563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.773130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.782324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.782674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.782815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.782845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.782862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.783045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.783214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.783237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.783253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.785473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.795185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.795495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.795636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.795665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.795683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.795876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.796064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.796087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.796102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.798308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.807744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.808069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.808226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.808251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.808267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.808442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.808610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.808633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.808648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.811005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.820350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.820667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.820810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.820839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.820857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.821022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.821245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.821268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.821284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.823489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.833176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.833494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.833627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.833655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.833678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.833855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.834043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.834066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.834082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.836449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.845690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.846050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.846183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.846211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.846228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.846392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.846524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.846547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.846563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.848903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.858273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.858574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.858667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.858696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.858713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.858850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.859020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.859043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.859059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.861281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.870690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.870974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.871082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.871112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.871130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.871355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.871488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.871511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.871527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.004 [2024-10-16 07:25:35.873976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.004 [2024-10-16 07:25:35.883282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.004 [2024-10-16 07:25:35.883592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.883740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.004 [2024-10-16 07:25:35.883769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.004 [2024-10-16 07:25:35.883787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.004 [2024-10-16 07:25:35.883969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.004 [2024-10-16 07:25:35.884196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.004 [2024-10-16 07:25:35.884219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.004 [2024-10-16 07:25:35.884234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.005 [2024-10-16 07:25:35.886467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.005 [2024-10-16 07:25:35.895919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.005 [2024-10-16 07:25:35.896204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.896308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.896336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.005 [2024-10-16 07:25:35.896353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.005 [2024-10-16 07:25:35.896481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.005 [2024-10-16 07:25:35.896667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.005 [2024-10-16 07:25:35.896690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.005 [2024-10-16 07:25:35.896706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.005 [2024-10-16 07:25:35.898989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.005 [2024-10-16 07:25:35.908316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.005 [2024-10-16 07:25:35.908645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.908785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.908815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.005 [2024-10-16 07:25:35.908833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.005 [2024-10-16 07:25:35.909015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.005 [2024-10-16 07:25:35.909191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.005 [2024-10-16 07:25:35.909214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.005 [2024-10-16 07:25:35.909229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.005 [2024-10-16 07:25:35.911597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.005 [2024-10-16 07:25:35.920864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.005 [2024-10-16 07:25:35.921174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.921306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.921335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.005 [2024-10-16 07:25:35.921352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.005 [2024-10-16 07:25:35.921517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.005 [2024-10-16 07:25:35.921667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.005 [2024-10-16 07:25:35.921690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.005 [2024-10-16 07:25:35.921705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.005 [2024-10-16 07:25:35.924006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.005 [2024-10-16 07:25:35.933423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.005 [2024-10-16 07:25:35.933775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.933889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.005 [2024-10-16 07:25:35.933919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.005 [2024-10-16 07:25:35.933937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.005 [2024-10-16 07:25:35.934137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.005 [2024-10-16 07:25:35.934306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.005 [2024-10-16 07:25:35.934328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.005 [2024-10-16 07:25:35.934344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.005 [2024-10-16 07:25:35.936403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.264 [2024-10-16 07:25:35.946056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.264 [2024-10-16 07:25:35.946416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.946527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.946554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.264 [2024-10-16 07:25:35.946569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.264 [2024-10-16 07:25:35.946766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.264 [2024-10-16 07:25:35.946955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.264 [2024-10-16 07:25:35.946988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.264 [2024-10-16 07:25:35.947004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.264 [2024-10-16 07:25:35.949423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.264 [2024-10-16 07:25:35.958568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.264 [2024-10-16 07:25:35.958865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.958976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.959004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.264 [2024-10-16 07:25:35.959022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.264 [2024-10-16 07:25:35.959186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.264 [2024-10-16 07:25:35.959337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.264 [2024-10-16 07:25:35.959359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.264 [2024-10-16 07:25:35.959374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.264 [2024-10-16 07:25:35.961826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.264 [2024-10-16 07:25:35.971140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.264 [2024-10-16 07:25:35.971406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.971571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.264 [2024-10-16 07:25:35.971600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.264 [2024-10-16 07:25:35.971618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.264 [2024-10-16 07:25:35.971796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.264 [2024-10-16 07:25:35.971948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.264 [2024-10-16 07:25:35.971970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.264 [2024-10-16 07:25:35.971985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.264 [2024-10-16 07:25:35.974259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.264 [2024-10-16 07:25:35.983702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:35.984015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:35.984177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:35.984206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:35.984224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:35.984443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:35.984612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:35.984634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:35.984655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:35.986981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:35.996239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:35.996557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:35.996703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:35.996741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:35.996759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:35.996917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:35.997068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:35.997090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:35.997105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:35.999526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.008795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.009105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.009267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.009297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.009314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.009443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.009611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.009634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.009649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.011918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.021429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.021722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.021865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.021895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.021912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.022077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.022247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.022269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.022285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.024625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.033980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.034298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.034461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.034490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.034507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.034635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.034798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.034822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.034838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.036987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.046390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.046694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.046866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.046896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.046913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.047114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.047265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.047288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.047303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.049649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.058995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.059327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.059488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.059517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.059534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.059716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.059935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.059959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.059974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.062215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.071565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.071907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.072041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.072070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.072088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.072305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.072492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.072516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.072531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.074922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.084009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.084316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.084444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.084473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.084490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.084692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.084837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.084861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.265 [2024-10-16 07:25:36.084877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.265 [2024-10-16 07:25:36.087117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.265 [2024-10-16 07:25:36.096616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.265 [2024-10-16 07:25:36.096942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.097080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.265 [2024-10-16 07:25:36.097108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.265 [2024-10-16 07:25:36.097125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.265 [2024-10-16 07:25:36.097272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.265 [2024-10-16 07:25:36.097476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.265 [2024-10-16 07:25:36.097500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.097515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.099887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.109249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.109583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.109767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.109798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.109816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.109964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.110152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.110175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.110192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.112360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.121859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.122211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.122345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.122375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.122392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.122556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.122725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.122761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.122776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.124995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.134440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.134761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.134893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.134921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.134939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.135103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.135236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.135259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.135274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.137712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.147077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.147415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.147589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.147620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.147652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.147808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.147999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.148039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.148054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.150348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.159611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.159902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.160040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.160068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.160086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.160232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.160383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.160406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.160422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.162832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.172057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.172340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.172494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.172522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.172540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.172704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.172919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.172944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.172959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.175358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.184395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.184739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.184840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.184869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.184892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.185075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.185244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.185267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.185282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.187504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.266 [2024-10-16 07:25:36.196976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.266 [2024-10-16 07:25:36.197296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.197434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.266 [2024-10-16 07:25:36.197463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.266 [2024-10-16 07:25:36.197480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.266 [2024-10-16 07:25:36.197627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.266 [2024-10-16 07:25:36.197773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.266 [2024-10-16 07:25:36.197797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.266 [2024-10-16 07:25:36.197812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.266 [2024-10-16 07:25:36.200193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.209726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.210051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.210181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.210209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.210226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.210391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.210640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.210661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.210675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.212954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.222195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.222492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.222601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.222630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.222647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.222847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.223017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.223040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.223055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.225273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.234589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.234880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.235014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.235042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.235059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.235242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.235411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.235434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.235449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.237803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.247330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.247652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.247785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.247814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.247831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.248033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.248183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.248206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.248221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.250735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.259853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.260275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.260423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.260452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.260470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.260670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.260876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.260901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.260916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.263442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.272560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.272866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.273019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.273063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.273078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.273223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.273463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.273487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.273502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.275912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.285060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.285392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.285518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.285546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.285564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.285757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.285910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.285933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.285948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.288455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.526 [2024-10-16 07:25:36.297720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.526 [2024-10-16 07:25:36.298062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.298195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.526 [2024-10-16 07:25:36.298224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.526 [2024-10-16 07:25:36.298242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.526 [2024-10-16 07:25:36.298442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.526 [2024-10-16 07:25:36.298646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.526 [2024-10-16 07:25:36.298675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.526 [2024-10-16 07:25:36.298691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.526 [2024-10-16 07:25:36.301119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.310409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.310719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.310864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.310893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.310911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.311058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.311227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.311250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.311265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.313648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.322888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.323223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.323371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.323397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.323413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.323584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.323825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.323849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.323864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.326301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.335556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.335862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.336030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.336058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.336075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.336258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.336445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.336468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.336488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.338846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.348140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.348561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.348706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.348743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.348763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.348964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.349150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.349173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.349188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.351517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.360511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.360790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.360912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.360937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.360953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.361126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.361314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.361338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.361354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.363749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.373042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.373386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.373530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.373558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.373575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.373722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.373888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.373910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.373923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.376411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.385618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.385904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.386022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.386050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.386067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.386230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.386435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.386458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.386473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.388842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.398246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.398543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.398719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.398756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.398773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.398973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.399196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.399220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.399235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.401669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.410893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.411270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.411400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.411428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.411445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.411554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.411705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.411744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.527 [2024-10-16 07:25:36.411761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.527 [2024-10-16 07:25:36.414168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.527 [2024-10-16 07:25:36.423442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.527 [2024-10-16 07:25:36.423771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.423934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.527 [2024-10-16 07:25:36.423962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.527 [2024-10-16 07:25:36.423979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.527 [2024-10-16 07:25:36.424162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.527 [2024-10-16 07:25:36.424349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.527 [2024-10-16 07:25:36.424372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.528 [2024-10-16 07:25:36.424387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.528 [2024-10-16 07:25:36.426630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.528 [2024-10-16 07:25:36.436125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.528 [2024-10-16 07:25:36.436417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.436539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.436569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.528 [2024-10-16 07:25:36.436587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.528 [2024-10-16 07:25:36.436808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.528 [2024-10-16 07:25:36.436941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.528 [2024-10-16 07:25:36.436965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.528 [2024-10-16 07:25:36.436980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.528 [2024-10-16 07:25:36.439442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.528 [2024-10-16 07:25:36.448617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.528 [2024-10-16 07:25:36.448914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.449057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.449087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.528 [2024-10-16 07:25:36.449105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.528 [2024-10-16 07:25:36.449251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.528 [2024-10-16 07:25:36.449383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.528 [2024-10-16 07:25:36.449406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.528 [2024-10-16 07:25:36.449421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.528 [2024-10-16 07:25:36.451695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.528 [2024-10-16 07:25:36.461085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.528 [2024-10-16 07:25:36.461350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.461470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.528 [2024-10-16 07:25:36.461500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.528 [2024-10-16 07:25:36.461518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.528 [2024-10-16 07:25:36.461700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.528 [2024-10-16 07:25:36.461880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.528 [2024-10-16 07:25:36.461904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.528 [2024-10-16 07:25:36.461919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.528 [2024-10-16 07:25:36.464323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.473843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.474246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.474423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.474452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.474470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.474635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.474868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.474893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.474909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.477114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.486485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.486787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.486947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.486976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.486994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.487158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.487345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.487368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.487384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.489752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.498947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.499312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.499486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.499515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.499538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.499703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.499937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.499962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.499977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.502179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.511635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.511912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.512047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.512075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.512092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.512239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.512408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.512431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.512445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.514667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.524206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.524522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.524655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.524683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.524701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.524894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.525082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.525105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.525120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.527468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.536824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.537116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.537249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.537279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.537297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.537435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.537586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.537609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.537624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.540014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.549371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.549627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.549793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.549824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.549841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.550025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.550176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.550198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.550213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.552396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.561918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.562168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.562305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.788 [2024-10-16 07:25:36.562335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.788 [2024-10-16 07:25:36.562353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.788 [2024-10-16 07:25:36.562499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.788 [2024-10-16 07:25:36.562686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.788 [2024-10-16 07:25:36.562708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.788 [2024-10-16 07:25:36.562724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.788 [2024-10-16 07:25:36.565010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.788 [2024-10-16 07:25:36.574454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.788 [2024-10-16 07:25:36.574808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.574920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.574950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.574968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.575096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.575276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.575300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.575315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.577814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.586994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.587320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.587419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.587447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.587464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.587628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.587773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.587797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.587813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.590139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.599627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.599961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.600124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.600171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.600188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.600370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.600557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.600580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.600596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.602950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.612340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.612631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.612797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.612827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.612845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.613045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.613214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.613243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.613260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.615575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.624829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.625096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.625233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.625262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.625279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.625479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.625667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.625690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.625705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.627859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.637450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.637795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.637928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.637956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.637973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.638139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.638308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.638331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.638346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.640617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.649992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.650307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.650443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.650473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.650490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.650637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.650811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.650835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.650856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.653077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.662673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.662952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.663085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.663114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.663131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.663277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.663427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.789 [2024-10-16 07:25:36.663451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.789 [2024-10-16 07:25:36.663466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.789 [2024-10-16 07:25:36.665895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.789 [2024-10-16 07:25:36.675195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.789 [2024-10-16 07:25:36.675522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.675635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.789 [2024-10-16 07:25:36.675663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.789 [2024-10-16 07:25:36.675681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.789 [2024-10-16 07:25:36.675820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.789 [2024-10-16 07:25:36.675990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.790 [2024-10-16 07:25:36.676013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.790 [2024-10-16 07:25:36.676028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.790 [2024-10-16 07:25:36.678536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.790 [2024-10-16 07:25:36.687705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.790 [2024-10-16 07:25:36.688062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.688222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.688251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.790 [2024-10-16 07:25:36.688268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.790 [2024-10-16 07:25:36.688397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.790 [2024-10-16 07:25:36.688583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.790 [2024-10-16 07:25:36.688606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.790 [2024-10-16 07:25:36.688621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.790 [2024-10-16 07:25:36.690909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.790 [2024-10-16 07:25:36.700251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.790 [2024-10-16 07:25:36.700567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.700667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.700695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.790 [2024-10-16 07:25:36.700713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.790 [2024-10-16 07:25:36.700870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.790 [2024-10-16 07:25:36.701003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.790 [2024-10-16 07:25:36.701026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.790 [2024-10-16 07:25:36.701041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.790 [2024-10-16 07:25:36.703312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.790 [2024-10-16 07:25:36.712854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.790 [2024-10-16 07:25:36.713153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.713283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.713311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.790 [2024-10-16 07:25:36.713328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.790 [2024-10-16 07:25:36.713474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.790 [2024-10-16 07:25:36.713625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.790 [2024-10-16 07:25:36.713648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.790 [2024-10-16 07:25:36.713663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.790 [2024-10-16 07:25:36.715981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.790 [2024-10-16 07:25:36.725419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.790 [2024-10-16 07:25:36.725753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.725900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.790 [2024-10-16 07:25:36.725928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:33.790 [2024-10-16 07:25:36.725945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:33.790 [2024-10-16 07:25:36.726091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:33.790 [2024-10-16 07:25:36.726315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.790 [2024-10-16 07:25:36.726351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.790 [2024-10-16 07:25:36.726364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.790 [2024-10-16 07:25:36.728662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.049 [2024-10-16 07:25:36.738040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.049 [2024-10-16 07:25:36.738339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.738498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.738527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.049 [2024-10-16 07:25:36.738544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.049 [2024-10-16 07:25:36.738737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.049 [2024-10-16 07:25:36.738899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.049 [2024-10-16 07:25:36.738922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.049 [2024-10-16 07:25:36.738937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.049 [2024-10-16 07:25:36.741213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.049 [2024-10-16 07:25:36.750520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.049 [2024-10-16 07:25:36.750857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.751006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.751032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.049 [2024-10-16 07:25:36.751048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.049 [2024-10-16 07:25:36.751164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.049 [2024-10-16 07:25:36.751340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.049 [2024-10-16 07:25:36.751363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.049 [2024-10-16 07:25:36.751378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.049 [2024-10-16 07:25:36.753633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.049 [2024-10-16 07:25:36.762918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.049 [2024-10-16 07:25:36.763209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.763344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.049 [2024-10-16 07:25:36.763372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.049 [2024-10-16 07:25:36.763390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.049 [2024-10-16 07:25:36.763554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.049 [2024-10-16 07:25:36.763771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.049 [2024-10-16 07:25:36.763801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.049 [2024-10-16 07:25:36.763816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.049 [2024-10-16 07:25:36.766272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.049 [2024-10-16 07:25:36.775496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.775831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.775971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.776000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.776017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.776146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.776350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.776374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.776390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.778766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.788216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.788511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.788666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.788692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.788707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.788929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.789135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.789158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.789173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.791359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.800611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.800871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.801018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.801044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.801059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.801215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.801385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.801408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.801423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.803763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.813183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.813462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.813597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.813633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.813652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.813845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.814016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.814040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.814055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.816403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.825762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.826007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.826164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.826193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.826210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.826358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.826490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.826514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.826529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.828778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.838183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.838518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.838653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.838682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.838699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.838896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.839068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.839090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.839106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.841364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.850947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.851248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.851357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.851385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.851408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.851573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.851725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.851773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.851788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.854064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.863357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.863678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.863800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.863829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.863847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.864011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.864185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.864208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.864224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.866577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.875937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.876272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.876375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.876401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.876417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.876635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.876854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.876878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.876894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.879221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.050 [2024-10-16 07:25:36.888709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.050 [2024-10-16 07:25:36.889010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.889148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.050 [2024-10-16 07:25:36.889178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.050 [2024-10-16 07:25:36.889196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.050 [2024-10-16 07:25:36.889350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.050 [2024-10-16 07:25:36.889483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.050 [2024-10-16 07:25:36.889506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.050 [2024-10-16 07:25:36.889522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.050 [2024-10-16 07:25:36.891919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.901144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.901471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.901602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.901631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.901648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.901807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.901996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.902019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.902034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.904417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.913897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.914171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.914313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.914342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.914359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.914524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.914639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.914663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.914678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.917015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.926742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.927067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.927201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.927230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.927247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.927429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.927586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.927609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.927624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.930065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.939398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.939742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.939878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.939909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.939926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.940091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.940242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.940265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.940281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.942687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.951852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.952179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.952338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.952367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.952384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.952566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.952747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.952771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.952786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.955136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.964463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.964784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.964928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.964956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.964973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.965156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.965308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.965336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.965352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.967703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.977151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.977414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.977509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.977538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.977555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.977786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.977938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.977961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.977976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.051 [2024-10-16 07:25:36.980288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.051 [2024-10-16 07:25:36.989594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.051 [2024-10-16 07:25:36.990014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.990212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.051 [2024-10-16 07:25:36.990262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.051 [2024-10-16 07:25:36.990279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.051 [2024-10-16 07:25:36.990480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.051 [2024-10-16 07:25:36.990696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.051 [2024-10-16 07:25:36.990717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.051 [2024-10-16 07:25:36.990742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:36.993107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.002221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.002540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.002669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.002697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.002715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.002908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.003060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.003083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.003104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.005506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.014884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.015181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.015296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.015324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.015342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.015488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.015639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.015662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.015677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.018032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.027394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.027668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.027790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.027819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.027837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.027984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.028152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.028175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.028190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.030668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.039880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.040251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.040410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.040439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.040457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.040604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.040768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.040792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.040807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.043227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.052371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.052676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.052850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.052880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.052899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.053045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.053232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.053255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.053271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.055690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.065002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.065384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.065544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.065573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.065590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.065783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.065989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.066012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.066027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.068390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.077492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.077791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.077980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.078014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.078049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.311 [2024-10-16 07:25:37.078159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.311 [2024-10-16 07:25:37.078310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.311 [2024-10-16 07:25:37.078333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.311 [2024-10-16 07:25:37.078348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.311 [2024-10-16 07:25:37.080670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.311 [2024-10-16 07:25:37.090057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.311 [2024-10-16 07:25:37.090393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.090512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.311 [2024-10-16 07:25:37.090541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.311 [2024-10-16 07:25:37.090558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.090751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.090931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.090954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.090970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.093280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.102739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.103118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.103296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.103340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.103357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.103539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.103707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.103743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.103761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.106020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.115293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.115580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.115709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.115767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.115786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.115950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.116102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.116125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.116140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.118235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.127900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.128184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.128328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.128357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.128374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.128521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.128654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.128677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.128692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.131034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.140391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.140664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.140804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.140833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.140850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.140997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.141148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.141171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.141186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.143459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.152810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.153200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.153386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.153415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.153432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.153614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.153795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.153819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.153834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.156054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.165261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.165629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.165808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.165837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.165860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.166044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.166231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.166254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.166269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.168653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.178010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.178342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.178517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.178542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.178558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.178767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.178901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.178921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.178934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.181248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.190627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.190970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.191104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.191150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.191167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.191350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.191555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.191578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.191593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.193933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.203090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.203379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.203483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.203512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.312 [2024-10-16 07:25:37.203529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.312 [2024-10-16 07:25:37.203718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.312 [2024-10-16 07:25:37.203862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.312 [2024-10-16 07:25:37.203886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.312 [2024-10-16 07:25:37.203901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.312 [2024-10-16 07:25:37.206447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.312 [2024-10-16 07:25:37.215564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.312 [2024-10-16 07:25:37.215908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.216049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.312 [2024-10-16 07:25:37.216077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.313 [2024-10-16 07:25:37.216094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.313 [2024-10-16 07:25:37.216258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.313 [2024-10-16 07:25:37.216391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.313 [2024-10-16 07:25:37.216414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.313 [2024-10-16 07:25:37.216429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.313 [2024-10-16 07:25:37.218805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.313 [2024-10-16 07:25:37.228217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.313 [2024-10-16 07:25:37.228510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.313 [2024-10-16 07:25:37.228623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.313 [2024-10-16 07:25:37.228652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.313 [2024-10-16 07:25:37.228669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.313 [2024-10-16 07:25:37.228810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.313 [2024-10-16 07:25:37.228998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.313 [2024-10-16 07:25:37.229021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.313 [2024-10-16 07:25:37.229036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.313 [2024-10-16 07:25:37.231115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.313 [2024-10-16 07:25:37.240914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.313 [2024-10-16 07:25:37.241288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.313 [2024-10-16 07:25:37.241423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.313 [2024-10-16 07:25:37.241449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.313 [2024-10-16 07:25:37.241464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.313 [2024-10-16 07:25:37.241622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.313 [2024-10-16 07:25:37.241826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.313 [2024-10-16 07:25:37.241851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.313 [2024-10-16 07:25:37.241866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.313 [2024-10-16 07:25:37.244284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.253416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.253772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.254027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.254044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.254191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.254325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.254347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.254362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.256710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.266244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.266595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.266719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.266758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.266776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.266923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.267128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.267151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.267166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.269457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.278864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.279120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.279290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.279341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.279359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.279487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.279692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.279721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.279748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.281987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.291339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.291686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.291841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.291871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.291888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.292054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.292204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.292227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.292242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.294778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.303598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.303874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.304035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.304052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.304217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.304421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.304444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.304459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.306465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.316121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.316466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.316601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.316629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.316647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.316843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.317048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.571 [2024-10-16 07:25:37.317071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.571 [2024-10-16 07:25:37.317092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.571 [2024-10-16 07:25:37.319368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.571 [2024-10-16 07:25:37.328648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.571 [2024-10-16 07:25:37.328894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.329062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.571 [2024-10-16 07:25:37.329090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.571 [2024-10-16 07:25:37.329108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.571 [2024-10-16 07:25:37.329273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.571 [2024-10-16 07:25:37.329460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.329483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.329498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.331933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.341255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.341512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.341672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.341701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.341719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.341894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.342027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.342050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.342065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.344393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.353716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.354053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.354163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.354191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.354209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.354427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.354614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.354637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.354652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.357016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.366292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.366649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.366780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.366809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.366827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.366992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.367106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.367128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.367144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.369545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.378852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.379230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.379400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.379425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.379441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.379556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.379769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.379793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.379809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.381919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.391521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.391895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.392129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.392178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.392195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.392360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.392511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.392534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.392549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.394954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.404237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.404531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.404660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.404688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.404706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.404918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.405089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.405112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.405127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.407473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.416707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.417054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.417194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.417241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.417258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.417459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.417609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.417632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.417648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.419931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.429315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.429697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.429845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.429874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.429891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.430038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.430189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.430211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.430227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.432394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.441904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.442222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.442357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.442387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.442404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.442604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.442719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.442754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.442770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.445027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.454496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.454826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.454987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.455015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.455033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.455162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.455312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.455335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.455350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.457678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.466782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.467111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.467245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.467273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.467290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.467509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.467678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.467701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.467716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.470091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.479498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.479793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.479929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.572 [2024-10-16 07:25:37.479963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.572 [2024-10-16 07:25:37.479982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.572 [2024-10-16 07:25:37.480184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.572 [2024-10-16 07:25:37.480317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.572 [2024-10-16 07:25:37.480341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.572 [2024-10-16 07:25:37.480356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.572 [2024-10-16 07:25:37.482561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.572 [2024-10-16 07:25:37.492230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.572 [2024-10-16 07:25:37.492566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.573 [2024-10-16 07:25:37.492700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.573 [2024-10-16 07:25:37.492736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.573 [2024-10-16 07:25:37.492757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.573 [2024-10-16 07:25:37.492904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.573 [2024-10-16 07:25:37.493091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.573 [2024-10-16 07:25:37.493115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.573 [2024-10-16 07:25:37.493130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.573 [2024-10-16 07:25:37.495591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.573 [2024-10-16 07:25:37.504586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.573 [2024-10-16 07:25:37.504923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.573 [2024-10-16 07:25:37.505051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.573 [2024-10-16 07:25:37.505092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.573 [2024-10-16 07:25:37.505107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.573 [2024-10-16 07:25:37.505252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.573 [2024-10-16 07:25:37.505454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.573 [2024-10-16 07:25:37.505478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.573 [2024-10-16 07:25:37.505492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.573 [2024-10-16 07:25:37.507809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.832 [2024-10-16 07:25:37.517303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.832 [2024-10-16 07:25:37.517649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.832 [2024-10-16 07:25:37.517774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.832 [2024-10-16 07:25:37.517801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.832 [2024-10-16 07:25:37.517823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.832 [2024-10-16 07:25:37.517997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.832 [2024-10-16 07:25:37.518149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.832 [2024-10-16 07:25:37.518172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.832 [2024-10-16 07:25:37.518187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.832 [2024-10-16 07:25:37.520517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.832 [2024-10-16 07:25:37.529840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.832 [2024-10-16 07:25:37.530246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.832 [2024-10-16 07:25:37.530469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.832 [2024-10-16 07:25:37.530524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.832 [2024-10-16 07:25:37.530541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.530687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.530869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.530893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.530908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.533131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.542630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.542932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.543109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.543161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.543179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.543344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.543513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.543536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.543551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.545780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.555200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.555513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.555648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.555676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.555693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.555873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.556078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.556101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.556117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.558394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.567815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.568168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.568375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.568425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.568442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.568607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.568774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.568800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.568815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.571075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.580585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.580908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.581035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.581060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.581075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.581281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.581450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.581473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.581489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.583679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.593164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.593464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.593605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.593633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.593650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.593770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.593964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.593988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.594004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.596267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.605790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.606102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.606229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.606257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.606274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.606438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.606589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.606612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.606627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.608825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.618386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.618713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.618859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.618889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.618906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.619088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.619240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.619264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.619280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.621485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.630920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.631250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.631406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.631435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.631452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.631653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.631815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.631845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.631861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.634073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.643430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.643756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.643897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.643926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.833 [2024-10-16 07:25:37.643943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.833 [2024-10-16 07:25:37.644108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.833 [2024-10-16 07:25:37.644276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.833 [2024-10-16 07:25:37.644299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.833 [2024-10-16 07:25:37.644315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.833 [2024-10-16 07:25:37.646588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.833 [2024-10-16 07:25:37.655974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.833 [2024-10-16 07:25:37.656403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.833 [2024-10-16 07:25:37.656586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.656628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.656644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.656735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.656891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.656928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.656943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.659251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.668510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.668821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.668939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.668969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.668987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.669115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.669284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.669307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.669328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.671710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.681099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.681414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.681536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.681565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.681582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.681775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.681909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.681932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.681947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.684453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.693783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.694190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.694299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.694326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.694343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.694489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.694640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.694663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.694678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.696961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.706351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.706630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.706742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.706772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.706789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.706954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.707141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.707164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.707179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.709485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.719021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.719323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.719483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.719513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.719530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.719676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.719856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.719881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.719896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.722208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.731471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.731793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.731902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.731931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.731948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.732076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.732245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.732269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.732284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.734652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.744044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.744386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.744518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.744547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.744564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.744692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.744907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.744932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.744947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.747242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.756670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.757008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.757167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.757196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.757214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.757342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.757529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.757551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.757567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.759802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.834 [2024-10-16 07:25:37.769328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.834 [2024-10-16 07:25:37.769628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.769756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.834 [2024-10-16 07:25:37.769786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:34.834 [2024-10-16 07:25:37.769803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:34.834 [2024-10-16 07:25:37.769950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:34.834 [2024-10-16 07:25:37.770101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.834 [2024-10-16 07:25:37.770124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.834 [2024-10-16 07:25:37.770139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.834 [2024-10-16 07:25:37.772560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.781893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.782175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.782311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.782339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.782356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.782539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.782754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.782779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.782794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.784975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.794441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.794723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.794868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.794897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.794914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.795061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.795211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.795233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.795248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.797597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.807423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.807725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.807854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.807880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.807895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.808093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.808238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.808261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.808276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.810550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.820106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.820429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.820562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.820591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.820608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.820802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.820972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.820995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.821010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.823445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.832775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.833157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.833347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.833376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.833399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.833582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.833778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.833802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.833817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.836034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.845535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.845960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.846187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.846254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.846271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.846454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.846605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.846628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.846643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.848909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.858245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.858523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.858662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.858690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.858708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.858919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.859107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.859130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.859144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.861508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.870995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.871317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.871466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.871495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.871512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.871664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.871844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.871868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.871883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.874193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.883683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.884059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.884202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.884230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.094 [2024-10-16 07:25:37.884247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.094 [2024-10-16 07:25:37.884376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.094 [2024-10-16 07:25:37.884562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.094 [2024-10-16 07:25:37.884586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.094 [2024-10-16 07:25:37.884601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.094 [2024-10-16 07:25:37.887223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.094 [2024-10-16 07:25:37.896072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.094 [2024-10-16 07:25:37.896379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.094 [2024-10-16 07:25:37.896511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.896540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.896558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.896748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.896954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.896977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.896992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.899301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.908865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.909140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.909295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.909322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.909339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.909486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.909660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.909683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.909698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.912092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.921426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.921745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.921892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.921920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.921937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.922066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.922216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.922238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.922254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.924584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.934121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.934423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.934581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.934609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.934626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.934783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.934934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.934957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.934972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.937154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.946659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.946935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.947068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.947094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.947109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.947264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.947451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.947480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.947496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.949927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.959330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.959625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.959759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.959788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.959806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.959988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.960158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.960181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.960196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.962652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.972055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.972376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.972550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.972579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.972596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.972706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.972896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.972920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.972935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.974974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.984677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.984991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.985109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.985139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.985156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.985286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.985436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.985458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.985479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:37.987745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:37.997095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:37.997424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.997557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:37.997586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:37.997604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:37.997834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:37.998022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:37.998045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:37.998060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:38.000531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:38.009651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:38.009978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:38.010113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.095 [2024-10-16 07:25:38.010142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.095 [2024-10-16 07:25:38.010159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.095 [2024-10-16 07:25:38.010305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.095 [2024-10-16 07:25:38.010511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.095 [2024-10-16 07:25:38.010534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.095 [2024-10-16 07:25:38.010549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.095 [2024-10-16 07:25:38.012833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.095 [2024-10-16 07:25:38.022102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.095 [2024-10-16 07:25:38.022419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.096 [2024-10-16 07:25:38.022576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.096 [2024-10-16 07:25:38.022605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.096 [2024-10-16 07:25:38.022623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.096 [2024-10-16 07:25:38.022762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.096 [2024-10-16 07:25:38.022987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.096 [2024-10-16 07:25:38.023011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.096 [2024-10-16 07:25:38.023026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.096 [2024-10-16 07:25:38.025195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.096 [2024-10-16 07:25:38.034403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.096 [2024-10-16 07:25:38.034696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.096 [2024-10-16 07:25:38.034860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.096 [2024-10-16 07:25:38.034886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.096 [2024-10-16 07:25:38.034902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.096 [2024-10-16 07:25:38.035054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.096 [2024-10-16 07:25:38.035241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.096 [2024-10-16 07:25:38.035265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.354 [2024-10-16 07:25:38.035280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.354 [2024-10-16 07:25:38.037538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.354 [2024-10-16 07:25:38.047054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.354 [2024-10-16 07:25:38.047347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.047484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.047510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.047525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.047673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.047891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.047915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.047931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.050347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.059606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.059866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.060004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.060032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.060049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.060267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.060436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.060458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.060473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.062621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.072013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.072342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.072504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.072532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.072549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.072713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.072874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.072897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.072913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.075466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.084430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.084705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.084835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.084865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.084882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.085047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.085234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.085257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.085273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.087773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.097020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.097364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.097521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.097550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.097567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.097760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.097912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.097935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.097950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.100147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.109746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.110047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.110186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.110215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.110232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.110360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.110475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.110497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.110512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.112759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.122277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.122630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.122759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.122789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.122806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.122990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.123195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.123219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.123234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.125705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.134829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.135157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.135289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.135314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.135330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.135516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.135667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.135690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.135705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.138076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.147357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.147678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.147828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.147863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.147881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.148065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.148252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.355 [2024-10-16 07:25:38.148275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.355 [2024-10-16 07:25:38.148290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.355 [2024-10-16 07:25:38.150842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.355 [2024-10-16 07:25:38.159872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.355 [2024-10-16 07:25:38.160187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.160322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.355 [2024-10-16 07:25:38.160350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.355 [2024-10-16 07:25:38.160368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.355 [2024-10-16 07:25:38.160550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.355 [2024-10-16 07:25:38.160682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.160705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.160721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.163132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.172456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.172744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.172886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.172912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.172927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.173059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.173273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.173296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.173312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.175791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.185045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.185373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.185500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.185529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.185552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.185746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.185934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.185957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.185973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.188209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.197626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.197945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.198104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.198132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.198149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.198332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.198501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.198524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.198539] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.201020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.210509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.210785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.210922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.210951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.210968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.211170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.211375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.211398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.211414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.213842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.223121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.223439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.223569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.223597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.223614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.223778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.223893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.223917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.223932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.226351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.235713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.236022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.236157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.236185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.236202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.236349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.236536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.236558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.236574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.238983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.248094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.248391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.248525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.248554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.248572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.248700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.248860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.248884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.248899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.251263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.260660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.260982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.261092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.261121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.261138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.261321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.261459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.261483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.261498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.263924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.273229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.273500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.273658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.273687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.273704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.273936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.274142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.356 [2024-10-16 07:25:38.274166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.356 [2024-10-16 07:25:38.274181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.356 [2024-10-16 07:25:38.276384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.356 [2024-10-16 07:25:38.285618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.356 [2024-10-16 07:25:38.285991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.286141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.356 [2024-10-16 07:25:38.286167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.356 [2024-10-16 07:25:38.286182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.356 [2024-10-16 07:25:38.286409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.356 [2024-10-16 07:25:38.286596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.357 [2024-10-16 07:25:38.286620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.357 [2024-10-16 07:25:38.286635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.357 [2024-10-16 07:25:38.288790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.298216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.298528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.298674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.298703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.298720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.298915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.299084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.299115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.299131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.301466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.310801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.311218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.311246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.311263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.311428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.311633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.311656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.311672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.314007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.323431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.323782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.323911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.323940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.323957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.324157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.324327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.324350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.324365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.326602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.335834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.336184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.336342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.336370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.336387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.336515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.336703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.336726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.336759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.338746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.348467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.348743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.348871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.348900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.348917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.349100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.349269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.349292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.349307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.351807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.361020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.361319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.361458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.361486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.361503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.361686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.361901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.361925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.361940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.364267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.373747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.374108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.374222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.374250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.374267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.374468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.374637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.374659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.374675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.377108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.386436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.386745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.386855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.386884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.616 [2024-10-16 07:25:38.386902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.616 [2024-10-16 07:25:38.387084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.616 [2024-10-16 07:25:38.387217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.616 [2024-10-16 07:25:38.387240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.616 [2024-10-16 07:25:38.387255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.616 [2024-10-16 07:25:38.389489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.616 [2024-10-16 07:25:38.398844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.616 [2024-10-16 07:25:38.399137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.616 [2024-10-16 07:25:38.399297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.399325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.399342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.399488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.399657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.399680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.399695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.402107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.411219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.411457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.411557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.411586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.411603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.411761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.411930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.411954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.411969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.414401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.423745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.424078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.424280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.424297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.424480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.424648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.424671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.424686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.427058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.436383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.436723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.436866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.436894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.436912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.437059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.437227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.437250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.437265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.439542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.449173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.449520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.449681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.449709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.449737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.449923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.450091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.450114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.450129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.452365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.461620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.461984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.462123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.462152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.462169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.462315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.462484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.462507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.462522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.464986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.474017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.474294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.474435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.474463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.474480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.474627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.474806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.474830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.474846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.476954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.486581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.486883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.487041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.487069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.487085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.487232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.487418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.487441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.487456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.489740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.499175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.499508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.499640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.499668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.499691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.499902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.500054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.500077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.500092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.502436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.511929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.512234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.512462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.617 [2024-10-16 07:25:38.512488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.617 [2024-10-16 07:25:38.512518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.617 [2024-10-16 07:25:38.512688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.617 [2024-10-16 07:25:38.512868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.617 [2024-10-16 07:25:38.512893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.617 [2024-10-16 07:25:38.512908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.617 [2024-10-16 07:25:38.515145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.617 [2024-10-16 07:25:38.524537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.617 [2024-10-16 07:25:38.524917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.525065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.525094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.618 [2024-10-16 07:25:38.525111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.618 [2024-10-16 07:25:38.525294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.618 [2024-10-16 07:25:38.525499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.618 [2024-10-16 07:25:38.525522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.618 [2024-10-16 07:25:38.525537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.618 [2024-10-16 07:25:38.527893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.618 [2024-10-16 07:25:38.537187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.618 [2024-10-16 07:25:38.537562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.537800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.537831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.618 [2024-10-16 07:25:38.537848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.618 [2024-10-16 07:25:38.537982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.618 [2024-10-16 07:25:38.538115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.618 [2024-10-16 07:25:38.538139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.618 [2024-10-16 07:25:38.538154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.618 [2024-10-16 07:25:38.540409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.618 [2024-10-16 07:25:38.549739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.618 [2024-10-16 07:25:38.550067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.550315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.618 [2024-10-16 07:25:38.550376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.618 [2024-10-16 07:25:38.550394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.618 [2024-10-16 07:25:38.550594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.618 [2024-10-16 07:25:38.550772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.618 [2024-10-16 07:25:38.550797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.618 [2024-10-16 07:25:38.550812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.618 [2024-10-16 07:25:38.553138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.877 [2024-10-16 07:25:38.562181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.877 [2024-10-16 07:25:38.562515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.877 [2024-10-16 07:25:38.562662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.877 [2024-10-16 07:25:38.562687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.877 [2024-10-16 07:25:38.562703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.877 [2024-10-16 07:25:38.562874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.877 [2024-10-16 07:25:38.563010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.877 [2024-10-16 07:25:38.563031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.877 [2024-10-16 07:25:38.563044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.877 [2024-10-16 07:25:38.565216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.877 [2024-10-16 07:25:38.574882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.877 [2024-10-16 07:25:38.575178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.877 [2024-10-16 07:25:38.575370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.877 [2024-10-16 07:25:38.575430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.575447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.575612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.575768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.575793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.575809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.578248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.587345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.587716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.587892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.587921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.587938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.588067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.588236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.588259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.588274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.590602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2020335 Killed "${NVMF_APP[@]}" "$@" 00:27:35.878 07:25:38 -- host/bdevperf.sh@36 -- # tgt_init 00:27:35.878 07:25:38 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:35.878 07:25:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:35.878 07:25:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:35.878 07:25:38 -- common/autotest_common.sh@10 -- # set +x 00:27:35.878 07:25:38 -- nvmf/common.sh@469 -- # nvmfpid=2021335 00:27:35.878 07:25:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:35.878 07:25:38 -- nvmf/common.sh@470 -- # waitforlisten 2021335 00:27:35.878 07:25:38 -- common/autotest_common.sh@819 -- # '[' -z 2021335 ']' 00:27:35.878 07:25:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:35.878 07:25:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:35.878 07:25:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:35.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:35.878 07:25:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:35.878 07:25:38 -- common/autotest_common.sh@10 -- # set +x 00:27:35.878 [2024-10-16 07:25:38.599850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.600198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.600326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.600351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.600366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.600525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.600684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.600724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.600753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.602774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.611944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.612280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.612412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.612438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.612453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.612601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.612789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.612811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.612825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.614751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.624101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.624445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.624551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.624579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.624594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.624736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.624946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.624966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.624979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.627168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.636265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.636782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.636809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.636825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.636957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.637132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.637152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.637171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.637652] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:35.878 [2024-10-16 07:25:38.637722] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:35.878 [2024-10-16 07:25:38.639234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.648635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.648948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.649058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.649083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.649099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.649199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.649402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.649422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.649435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.651568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.660770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.661086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.661229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.661255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.661270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.661459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.661630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.661650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.661662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 [2024-10-16 07:25:38.664019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.878 [2024-10-16 07:25:38.673105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.878 [2024-10-16 07:25:38.673431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.673595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.878 [2024-10-16 07:25:38.673620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.878 [2024-10-16 07:25:38.673636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.878 [2024-10-16 07:25:38.673744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.878 [2024-10-16 07:25:38.673879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.878 [2024-10-16 07:25:38.673905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.878 [2024-10-16 07:25:38.673919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.878 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.879 [2024-10-16 07:25:38.675939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.685665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.685960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.686136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.686175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.686192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.686302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.686489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.686512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.686527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.688872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.698202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.698536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.698698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.698740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.698776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.698925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.699099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.699123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.699140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.701502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.710696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.710990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.711173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.711202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.711219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.711346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:35.879 [2024-10-16 07:25:38.711383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.711550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.711588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.711604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.713806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.723327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.723768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.723955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.723982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.724002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.724202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.724395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.724419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.724450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.726653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.735790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.736148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.736256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.736291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.736309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.736539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.736709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.736746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.736777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.739004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.748065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.748431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.748575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.748603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.748621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.748776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.748926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.748946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.748970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.751363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.760673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.761115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.761228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.761256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.761273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.761456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.761609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.761632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.761648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.763940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.773369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.773748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.773907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.773934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.773951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.774162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.774279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.774302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.774318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.776690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.785859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.786321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.786474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.786503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.786524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.786679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.786865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.879 [2024-10-16 07:25:38.786887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.879 [2024-10-16 07:25:38.786905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.879 [2024-10-16 07:25:38.789202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.879 [2024-10-16 07:25:38.798525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.879 [2024-10-16 07:25:38.798846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.798980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.879 [2024-10-16 07:25:38.799023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.879 [2024-10-16 07:25:38.799041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.879 [2024-10-16 07:25:38.799207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.879 [2024-10-16 07:25:38.799412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.880 [2024-10-16 07:25:38.799436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.880 [2024-10-16 07:25:38.799451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.880 [2024-10-16 07:25:38.801691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.880 [2024-10-16 07:25:38.811233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.880 [2024-10-16 07:25:38.811541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.880 [2024-10-16 07:25:38.811682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.880 [2024-10-16 07:25:38.811711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:35.880 [2024-10-16 07:25:38.811738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:35.880 [2024-10-16 07:25:38.811924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:35.880 [2024-10-16 07:25:38.812070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.880 [2024-10-16 07:25:38.812108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.880 [2024-10-16 07:25:38.812124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.880 [2024-10-16 07:25:38.814369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.139 [2024-10-16 07:25:38.823686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.139 [2024-10-16 07:25:38.824040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.824168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.824197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.139 [2024-10-16 07:25:38.824215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.139 [2024-10-16 07:25:38.824379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.139 [2024-10-16 07:25:38.824619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.139 [2024-10-16 07:25:38.824640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.139 [2024-10-16 07:25:38.824654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.139 [2024-10-16 07:25:38.827138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.139 [2024-10-16 07:25:38.828680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:36.139 [2024-10-16 07:25:38.828830] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:36.139 [2024-10-16 07:25:38.828851] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:36.139 [2024-10-16 07:25:38.828864] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:36.139 [2024-10-16 07:25:38.828916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:36.139 [2024-10-16 07:25:38.828967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:36.139 [2024-10-16 07:25:38.828970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:36.139 [2024-10-16 07:25:38.836022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.139 [2024-10-16 07:25:38.836436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.836574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.836601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.139 [2024-10-16 07:25:38.836620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.139 [2024-10-16 07:25:38.836787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.139 [2024-10-16 07:25:38.836943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.139 [2024-10-16 07:25:38.836964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.139 [2024-10-16 07:25:38.836982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.139 [2024-10-16 07:25:38.838958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.139 [2024-10-16 07:25:38.848504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.139 [2024-10-16 07:25:38.848924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.849065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.139 [2024-10-16 07:25:38.849091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.139 [2024-10-16 07:25:38.849111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.139 [2024-10-16 07:25:38.849269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.139 [2024-10-16 07:25:38.849424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.139 [2024-10-16 07:25:38.849446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.139 [2024-10-16 07:25:38.849463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.139 [2024-10-16 07:25:38.851486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.860943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.861326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.861469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.861496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.861517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.861709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.861876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.861898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.861916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.864106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.873375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.873864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.873986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.874021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.874042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.874266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.874422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.874443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.874461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.876614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.886069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.886419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.886585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.886611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.886630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.886796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.886951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.886973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.886989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.889251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.898325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.898740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.898851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.898878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.898897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.899040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.899228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.899260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.899278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.901284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.910541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.910947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.911068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.911095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.911117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.911262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.911465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.911487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.911504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.913679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.922849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.923115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.923243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.923269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.923286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.923435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.923617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.923638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.923651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.925768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.935033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.935329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.935453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.935478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.935494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.935659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.935806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.935828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.935850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.938009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.947347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.947633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.947759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.947786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.947801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.947934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.948101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.948121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.948134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.950102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.959636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.959942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.960050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.960075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.960091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.960223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.960389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.960409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.960422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.962566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.140 [2024-10-16 07:25:38.971831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.140 [2024-10-16 07:25:38.972154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.972267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.140 [2024-10-16 07:25:38.972293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.140 [2024-10-16 07:25:38.972309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.140 [2024-10-16 07:25:38.972457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.140 [2024-10-16 07:25:38.972623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.140 [2024-10-16 07:25:38.972643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.140 [2024-10-16 07:25:38.972656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.140 [2024-10-16 07:25:38.974632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:38.984180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:38.984470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:38.984565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:38.984591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:38.984606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:38.984796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:38.984981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:38.985002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:38.985016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:38.987162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:38.996494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:38.996812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:38.996961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:38.996986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:38.997002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:38.997166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:38.997316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:38.997336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:38.997350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:38.999446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.008744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.008995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.009125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.009150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.009165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.009346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.009542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.009563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.009576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.011672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.021153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.021446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.021544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.021570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.021585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.021717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.021863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.021884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.021898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.023923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.033451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.033779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.033884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.033909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.033924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.034072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.034222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.034243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.034257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.036445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.045714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.046012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.046141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.046168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.046183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.046331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.046450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.046471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.046484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.048488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.057957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.058210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.058338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.058364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.058379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.058544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.058648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.058669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.058682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.060831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.141 [2024-10-16 07:25:39.070288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.141 [2024-10-16 07:25:39.070536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.070688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.141 [2024-10-16 07:25:39.070715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.141 [2024-10-16 07:25:39.070736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.141 [2024-10-16 07:25:39.070887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.141 [2024-10-16 07:25:39.071055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.141 [2024-10-16 07:25:39.071076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.141 [2024-10-16 07:25:39.071089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.141 [2024-10-16 07:25:39.073087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.400 [2024-10-16 07:25:39.082709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.400 [2024-10-16 07:25:39.083043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.400 [2024-10-16 07:25:39.083160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.400 [2024-10-16 07:25:39.083187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.400 [2024-10-16 07:25:39.083202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.400 [2024-10-16 07:25:39.083351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.400 [2024-10-16 07:25:39.083474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.400 [2024-10-16 07:25:39.083494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.400 [2024-10-16 07:25:39.083507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.400 [2024-10-16 07:25:39.085689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.400 [2024-10-16 07:25:39.095164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.400 [2024-10-16 07:25:39.095439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.400 [2024-10-16 07:25:39.095589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.400 [2024-10-16 07:25:39.095620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.400 [2024-10-16 07:25:39.095637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.400 [2024-10-16 07:25:39.095762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.095932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.095954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.095967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.097923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.107381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.107650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.107752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.107779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.107794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.107943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.108077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.108098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.108111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.110148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.119657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.119976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.120133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.120159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.120174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.120322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.120457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.120477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.120490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.122719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.131879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.132120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.132222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.132249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.132270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.132404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.132568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.132589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.132602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.134733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.144036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.144351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.144489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.144521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.144536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.144685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.144877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.144899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.144914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.146962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.156588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.156866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.156981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.157006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.157022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.157138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.157274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.157295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.157308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.159199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.168922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.169198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.169322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.169348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.169364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.169534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.169866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.169896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.169911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.171941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.181273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.181544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.181651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.181677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.181693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.181818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.181971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.181992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.182006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.184135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.193490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.193775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.193903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.193929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.193944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.194125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.194290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.194310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.194323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.196436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.205805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.206157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.206290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.206315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.401 [2024-10-16 07:25:39.206331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.401 [2024-10-16 07:25:39.206462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.401 [2024-10-16 07:25:39.206634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.401 [2024-10-16 07:25:39.206655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.401 [2024-10-16 07:25:39.206668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.401 [2024-10-16 07:25:39.208764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.401 [2024-10-16 07:25:39.218121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.401 [2024-10-16 07:25:39.218401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.218520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.401 [2024-10-16 07:25:39.218545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.218562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.218725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.218871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.218892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.218906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.221006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.230441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.230711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.230848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.230874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.230889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.231005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.231156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.231177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.231191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.233257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.242681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.242973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.243062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.243088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.243103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.243267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.243463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.243489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.243503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.245565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.255016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.255272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.255416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.255442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.255457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.255556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.255724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.255767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.255781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.257773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.267278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.267567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.267697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.267722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.267746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.267895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.268063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.268084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.268097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.270211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.279475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.279701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.279812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.279838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.279854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.280002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.280166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.280187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.280206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.282324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.291607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.291906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.292001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.292026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.292042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.292190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.292371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.292392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.292405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.294539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.303904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.304205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.304330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.304355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.304371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.304502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.304669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.304689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.304702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.306816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.316311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.316586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.316739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.316766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.316782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.316946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.317112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.402 [2024-10-16 07:25:39.317133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.402 [2024-10-16 07:25:39.317146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.402 [2024-10-16 07:25:39.319142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.402 [2024-10-16 07:25:39.328406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.402 [2024-10-16 07:25:39.328667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.328791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.402 [2024-10-16 07:25:39.328817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.402 [2024-10-16 07:25:39.328833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.402 [2024-10-16 07:25:39.328981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.402 [2024-10-16 07:25:39.329146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.403 [2024-10-16 07:25:39.329167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.403 [2024-10-16 07:25:39.329180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.403 [2024-10-16 07:25:39.331251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.403 [2024-10-16 07:25:39.340709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.403 [2024-10-16 07:25:39.341001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.403 [2024-10-16 07:25:39.341101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.403 [2024-10-16 07:25:39.341128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.403 [2024-10-16 07:25:39.341143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.403 [2024-10-16 07:25:39.341276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.403 [2024-10-16 07:25:39.341442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.403 [2024-10-16 07:25:39.341463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.403 [2024-10-16 07:25:39.341476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.343396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.353093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.353318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.353423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.353449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.353465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.353596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.353773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.353795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.353809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.355899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.365352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.365641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.365775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.365803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.365818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.365967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.366133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.366153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.366166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.368156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.377676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.377982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.378111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.378138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.378154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.378335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.378500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.378520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.378533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.380686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.390028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.390319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.390454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.390480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.390495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.390626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.390786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.390808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.390822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.393195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.402209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.402464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.402593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.402619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.402635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.402811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.402964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.402985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.402999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.405245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.414660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.414974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.415126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.415152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.415167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.415283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.415480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.415500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.415513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.417421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.426884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.662 [2024-10-16 07:25:39.427194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.427289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.662 [2024-10-16 07:25:39.427315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.662 [2024-10-16 07:25:39.427331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.662 [2024-10-16 07:25:39.427479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.662 [2024-10-16 07:25:39.427643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.662 [2024-10-16 07:25:39.427664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.662 [2024-10-16 07:25:39.427677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.662 [2024-10-16 07:25:39.429683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.662 [2024-10-16 07:25:39.439113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.439411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.439533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.439558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.439581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.439772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.439952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.439973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.439987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.442116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.451339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.451614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.451741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.451768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.451784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.451949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.452130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.452151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.452164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.454294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.463564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.463881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.464003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.464029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.464044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.464225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.464358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.464378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.464392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.466452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.475759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.476018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.476115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.476142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.476157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.476295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.476477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.476498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.476511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.478631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.488055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.488299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.488424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.488449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.488465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.488630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.488822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.488844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.488858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.490892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.500414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.500692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.500839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.500866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.500881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.500997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.501196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.501216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.501229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.503244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.512588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.512856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.512975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.513000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.513016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.513181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.513367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.513389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.513403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.515469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.524865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.525180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.525270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.525295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.525311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.525427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.525561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.525582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.525595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.527556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.537293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.537541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.537668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.537694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.537710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.537833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.537970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.537992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.538006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.540149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.663 [2024-10-16 07:25:39.549655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.663 [2024-10-16 07:25:39.549957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.550084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.663 [2024-10-16 07:25:39.550110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.663 [2024-10-16 07:25:39.550126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.663 [2024-10-16 07:25:39.550322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.663 [2024-10-16 07:25:39.550502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.663 [2024-10-16 07:25:39.550528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.663 [2024-10-16 07:25:39.550542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.663 [2024-10-16 07:25:39.552851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.664 [2024-10-16 07:25:39.562069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.664 [2024-10-16 07:25:39.562369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.562493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.562518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.664 [2024-10-16 07:25:39.562534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.664 [2024-10-16 07:25:39.562665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.664 [2024-10-16 07:25:39.562844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.664 [2024-10-16 07:25:39.562867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.664 [2024-10-16 07:25:39.562880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.664 [2024-10-16 07:25:39.564917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.664 [2024-10-16 07:25:39.574143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.664 [2024-10-16 07:25:39.574393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.574524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.574550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.664 [2024-10-16 07:25:39.574567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.664 [2024-10-16 07:25:39.574683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.664 [2024-10-16 07:25:39.574827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.664 [2024-10-16 07:25:39.574849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.664 [2024-10-16 07:25:39.574863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.664 [2024-10-16 07:25:39.577104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.664 [2024-10-16 07:25:39.586194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.664 [2024-10-16 07:25:39.586470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.586616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.586643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.664 [2024-10-16 07:25:39.586659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.664 [2024-10-16 07:25:39.586787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.664 [2024-10-16 07:25:39.586909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.664 [2024-10-16 07:25:39.586929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.664 [2024-10-16 07:25:39.586949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.664 [2024-10-16 07:25:39.589020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.664 [2024-10-16 07:25:39.598460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.664 [2024-10-16 07:25:39.598766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.598886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.664 [2024-10-16 07:25:39.598911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.664 [2024-10-16 07:25:39.598928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.664 [2024-10-16 07:25:39.599060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.664 [2024-10-16 07:25:39.599212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.664 [2024-10-16 07:25:39.599232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.664 [2024-10-16 07:25:39.599245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.664 [2024-10-16 07:25:39.601394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.610759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.611028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.611151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.611177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.611192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.611374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.611523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.611543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.611557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.613775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.623111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.623420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.623543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.623569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.623584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.623758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.623942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.623963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.623977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.626171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.635479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.635760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.635883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.635909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.635925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.636106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.636226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.636246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.636260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.638414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 07:25:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:36.923 07:25:39 -- common/autotest_common.sh@852 -- # return 0 00:27:36.923 07:25:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:36.923 07:25:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:36.923 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.923 [2024-10-16 07:25:39.647896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.648190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.648336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.648370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.648386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.648534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.648668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.648688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.648701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.650774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.660434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.660761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.660864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.660889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.660904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.661069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.661205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.661225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.661245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 07:25:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:36.923 07:25:39 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:36.923 07:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.923 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.923 [2024-10-16 07:25:39.663458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.666498] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:36.923 07:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.923 07:25:39 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:36.923 07:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.923 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.923 [2024-10-16 07:25:39.672791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.673065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.673184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.673210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.673225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.673341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.673493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.673513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.673527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.675638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.685043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.685345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.685438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.685463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.685478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.685594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.685755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.685777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.685791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.688032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.697389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.697671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.697793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.697820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.923 [2024-10-16 07:25:39.697841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.923 [2024-10-16 07:25:39.697958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.923 [2024-10-16 07:25:39.698141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.923 [2024-10-16 07:25:39.698162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.923 [2024-10-16 07:25:39.698176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.923 [2024-10-16 07:25:39.700388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.923 [2024-10-16 07:25:39.709868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.923 [2024-10-16 07:25:39.710285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.923 [2024-10-16 07:25:39.710428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.924 [2024-10-16 07:25:39.710455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.924 [2024-10-16 07:25:39.710474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.924 [2024-10-16 07:25:39.710632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.924 [2024-10-16 07:25:39.710816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.924 [2024-10-16 07:25:39.710839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.924 [2024-10-16 07:25:39.710856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.924 [2024-10-16 07:25:39.713103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.924 Malloc0 00:27:36.924 07:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.924 07:25:39 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:36.924 07:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.924 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.924 07:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.924 07:25:39 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:36.924 07:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.924 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.924 [2024-10-16 07:25:39.722381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.924 [2024-10-16 07:25:39.722606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.924 [2024-10-16 07:25:39.722748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.924 [2024-10-16 07:25:39.722776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbb0160 with addr=10.0.0.2, port=4420 00:27:36.924 [2024-10-16 07:25:39.722792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbb0160 is same with the state(5) to be set 00:27:36.924 [2024-10-16 07:25:39.722927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbb0160 (9): Bad file descriptor 00:27:36.924 [2024-10-16 07:25:39.723062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.924 [2024-10-16 07:25:39.723083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.924 [2024-10-16 07:25:39.723097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.924 [2024-10-16 07:25:39.725136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.924 07:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.924 07:25:39 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:36.924 07:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.924 07:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:36.924 [2024-10-16 07:25:39.733807] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:36.924 [2024-10-16 07:25:39.734820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.924 07:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.924 07:25:39 -- host/bdevperf.sh@38 -- # wait 2020648 00:27:36.924 [2024-10-16 07:25:39.769220] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:46.891 00:27:46.891 Latency(us) 00:27:46.891 [2024-10-16T05:25:49.831Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:46.891 [2024-10-16T05:25:49.831Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:46.891 Verification LBA range: start 0x0 length 0x4000 00:27:46.891 Nvme1n1 : 15.01 8997.33 35.15 16021.46 0.00 5101.27 740.31 22719.15 00:27:46.891 [2024-10-16T05:25:49.831Z] =================================================================================================================== 00:27:46.891 [2024-10-16T05:25:49.831Z] Total : 8997.33 35.15 16021.46 0.00 5101.27 740.31 22719.15 00:27:46.891 07:25:48 -- host/bdevperf.sh@39 -- # sync 00:27:46.891 07:25:48 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:46.891 07:25:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:46.891 07:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:46.891 07:25:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:46.891 07:25:48 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:46.891 07:25:48 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:46.891 07:25:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:46.891 07:25:48 -- nvmf/common.sh@116 -- # sync 00:27:46.891 07:25:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:46.891 07:25:48 -- nvmf/common.sh@119 -- # set +e 00:27:46.891 07:25:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:46.891 07:25:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:46.891 rmmod nvme_tcp 00:27:46.891 rmmod nvme_fabrics 00:27:46.891 rmmod nvme_keyring 00:27:46.891 07:25:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:46.891 07:25:48 -- nvmf/common.sh@123 -- # set -e 00:27:46.891 07:25:48 -- nvmf/common.sh@124 -- # return 0 00:27:46.891 07:25:48 -- nvmf/common.sh@477 -- # '[' -n 2021335 ']' 00:27:46.891 07:25:48 -- nvmf/common.sh@478 -- # killprocess 2021335 00:27:46.891 07:25:48 -- common/autotest_common.sh@926 -- # '[' -z 2021335 ']' 00:27:46.891 07:25:48 -- common/autotest_common.sh@930 -- # kill -0 2021335 00:27:46.891 07:25:48 -- common/autotest_common.sh@931 -- # uname 00:27:46.891 07:25:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:46.891 07:25:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2021335 00:27:46.891 07:25:48 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:46.891 07:25:48 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:46.891 07:25:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2021335' 00:27:46.891 killing process with pid 2021335 00:27:46.891 07:25:48 -- common/autotest_common.sh@945 -- # kill 2021335 00:27:46.891 07:25:48 -- common/autotest_common.sh@950 -- # wait 2021335 00:27:46.891 07:25:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:46.891 07:25:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:46.891 07:25:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:46.891 07:25:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:46.891 07:25:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:46.891 07:25:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:46.892 07:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:46.892 07:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:47.828 07:25:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:47.828 00:27:47.828 real 0m23.284s 00:27:47.828 user 1m1.761s 00:27:47.828 sys 0m4.770s 00:27:47.828 07:25:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:47.828 07:25:50 -- common/autotest_common.sh@10 -- # set +x 00:27:47.828 ************************************ 00:27:47.828 END TEST nvmf_bdevperf 00:27:47.828 ************************************ 00:27:47.828 07:25:50 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:47.828 07:25:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:47.828 07:25:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:47.828 07:25:50 -- common/autotest_common.sh@10 -- # set +x 00:27:47.828 ************************************ 00:27:47.828 START TEST nvmf_target_disconnect 00:27:47.828 ************************************ 00:27:47.828 07:25:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:48.086 * Looking for test storage... 00:27:48.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:48.086 07:25:50 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:48.086 07:25:50 -- nvmf/common.sh@7 -- # uname -s 00:27:48.086 07:25:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:48.086 07:25:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:48.086 07:25:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:48.086 07:25:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:48.086 07:25:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:48.086 07:25:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:48.086 07:25:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:48.086 07:25:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:48.086 07:25:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:48.086 07:25:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:48.086 07:25:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.086 07:25:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.086 07:25:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:48.086 07:25:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:48.086 07:25:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:48.086 07:25:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:48.086 07:25:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:48.086 07:25:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:48.086 07:25:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:48.086 07:25:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.086 07:25:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.086 07:25:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.086 07:25:50 -- paths/export.sh@5 -- # export PATH 00:27:48.086 07:25:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.086 07:25:50 -- nvmf/common.sh@46 -- # : 0 00:27:48.086 07:25:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:48.086 07:25:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:48.086 07:25:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:48.086 07:25:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:48.086 07:25:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:48.086 07:25:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:48.087 07:25:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:48.087 07:25:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:48.087 07:25:50 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:48.087 07:25:50 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:48.087 07:25:50 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:48.087 07:25:50 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:48.087 07:25:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:48.087 07:25:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:48.087 07:25:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:48.087 07:25:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:48.087 07:25:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:48.087 07:25:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:48.087 07:25:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:48.087 07:25:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.087 07:25:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:48.087 07:25:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:48.087 07:25:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:48.087 07:25:50 -- common/autotest_common.sh@10 -- # set +x 00:27:49.989 07:25:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:49.989 07:25:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:49.989 07:25:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:49.989 07:25:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:49.989 07:25:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:49.989 07:25:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:49.989 07:25:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:49.989 07:25:52 -- nvmf/common.sh@294 -- # net_devs=() 00:27:49.989 07:25:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:49.989 07:25:52 -- nvmf/common.sh@295 -- # e810=() 00:27:49.989 07:25:52 -- nvmf/common.sh@295 -- # local -ga e810 00:27:49.989 07:25:52 -- nvmf/common.sh@296 -- # x722=() 00:27:49.989 07:25:52 -- nvmf/common.sh@296 -- # local -ga x722 00:27:49.989 07:25:52 -- nvmf/common.sh@297 -- # mlx=() 00:27:49.989 07:25:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:49.989 07:25:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:49.989 07:25:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:49.989 07:25:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:49.990 07:25:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:49.990 07:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:49.990 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:49.990 07:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:49.990 07:25:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:49.990 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:49.990 07:25:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:49.990 07:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:49.990 07:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:49.990 07:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:49.990 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:49.990 07:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:49.990 07:25:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:49.990 07:25:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:49.990 07:25:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:49.990 07:25:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:49.990 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:49.990 07:25:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:49.990 07:25:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:49.990 07:25:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:49.990 07:25:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:49.990 07:25:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:49.990 07:25:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:49.990 07:25:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:49.990 07:25:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:49.990 07:25:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:49.990 07:25:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:49.990 07:25:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:49.990 07:25:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:49.990 07:25:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:49.990 07:25:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:49.990 07:25:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:49.990 07:25:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:49.990 07:25:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:49.990 07:25:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:49.990 07:25:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:49.990 07:25:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:49.990 07:25:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:50.249 07:25:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:50.249 07:25:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:50.249 07:25:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:50.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:50.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:27:50.249 00:27:50.249 --- 10.0.0.2 ping statistics --- 00:27:50.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.249 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:27:50.249 07:25:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:50.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:50.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:27:50.249 00:27:50.249 --- 10.0.0.1 ping statistics --- 00:27:50.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.249 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:27:50.249 07:25:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:50.249 07:25:52 -- nvmf/common.sh@410 -- # return 0 00:27:50.249 07:25:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:50.249 07:25:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:50.249 07:25:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:50.249 07:25:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:50.249 07:25:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:50.249 07:25:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:50.249 07:25:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:50.249 07:25:53 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:50.249 07:25:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:50.249 07:25:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:50.249 07:25:53 -- common/autotest_common.sh@10 -- # set +x 00:27:50.249 ************************************ 00:27:50.249 START TEST nvmf_target_disconnect_tc1 00:27:50.249 ************************************ 00:27:50.249 07:25:53 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:27:50.249 07:25:53 -- host/target_disconnect.sh@32 -- # set +e 00:27:50.249 07:25:53 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:50.249 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.249 [2024-10-16 07:25:53.080667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.249 [2024-10-16 07:25:53.080863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.249 [2024-10-16 07:25:53.080892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23f3b40 with addr=10.0.0.2, port=4420 00:27:50.249 [2024-10-16 07:25:53.080926] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:50.249 [2024-10-16 07:25:53.080946] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:50.249 [2024-10-16 07:25:53.080960] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:50.249 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:50.249 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:50.249 Initializing NVMe Controllers 00:27:50.249 07:25:53 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:50.249 07:25:53 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:50.249 07:25:53 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:27:50.249 07:25:53 -- common/autotest_common.sh@1132 -- # return 0 00:27:50.249 07:25:53 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:50.249 07:25:53 -- host/target_disconnect.sh@41 -- # set -e 00:27:50.249 00:27:50.249 real 0m0.082s 00:27:50.249 user 0m0.034s 00:27:50.249 sys 0m0.047s 00:27:50.249 07:25:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:50.249 07:25:53 -- common/autotest_common.sh@10 -- # set +x 00:27:50.249 ************************************ 00:27:50.249 END TEST nvmf_target_disconnect_tc1 00:27:50.249 ************************************ 00:27:50.249 07:25:53 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:50.249 07:25:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:50.249 07:25:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:50.249 07:25:53 -- common/autotest_common.sh@10 -- # set +x 00:27:50.249 ************************************ 00:27:50.249 START TEST nvmf_target_disconnect_tc2 00:27:50.249 ************************************ 00:27:50.249 07:25:53 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:27:50.249 07:25:53 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:50.249 07:25:53 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:50.249 07:25:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:50.249 07:25:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:50.249 07:25:53 -- common/autotest_common.sh@10 -- # set +x 00:27:50.249 07:25:53 -- nvmf/common.sh@469 -- # nvmfpid=2024522 00:27:50.249 07:25:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:50.249 07:25:53 -- nvmf/common.sh@470 -- # waitforlisten 2024522 00:27:50.249 07:25:53 -- common/autotest_common.sh@819 -- # '[' -z 2024522 ']' 00:27:50.249 07:25:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:50.249 07:25:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:50.249 07:25:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:50.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:50.249 07:25:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:50.249 07:25:53 -- common/autotest_common.sh@10 -- # set +x 00:27:50.249 [2024-10-16 07:25:53.168471] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:50.249 [2024-10-16 07:25:53.168542] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:50.507 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.507 [2024-10-16 07:25:53.230843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:50.507 [2024-10-16 07:25:53.339335] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:50.507 [2024-10-16 07:25:53.339485] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:50.507 [2024-10-16 07:25:53.339503] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:50.507 [2024-10-16 07:25:53.339515] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:50.507 [2024-10-16 07:25:53.339617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:50.507 [2024-10-16 07:25:53.339682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:50.507 [2024-10-16 07:25:53.339711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:50.507 [2024-10-16 07:25:53.339714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:51.441 07:25:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:51.441 07:25:54 -- common/autotest_common.sh@852 -- # return 0 00:27:51.441 07:25:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:51.441 07:25:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 07:25:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:51.441 07:25:54 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 Malloc0 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 [2024-10-16 07:25:54.192408] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 [2024-10-16 07:25:54.220655] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:51.441 07:25:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.441 07:25:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.441 07:25:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.441 07:25:54 -- host/target_disconnect.sh@50 -- # reconnectpid=2024677 00:27:51.441 07:25:54 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:51.441 07:25:54 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:51.441 EAL: No free 2048 kB hugepages reported on node 1 00:27:53.345 07:25:56 -- host/target_disconnect.sh@53 -- # kill -9 2024522 00:27:53.345 07:25:56 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 [2024-10-16 07:25:56.244979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Read completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.345 starting I/O failed 00:27:53.345 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 [2024-10-16 07:25:56.245322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 [2024-10-16 07:25:56.245676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Read completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 Write completed with error (sct=0, sc=8) 00:27:53.346 starting I/O failed 00:27:53.346 [2024-10-16 07:25:56.246001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.346 [2024-10-16 07:25:56.246176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.246495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.246784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.246963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.247094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.247366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.247651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.247823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.247942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.248137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.248179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.248320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.248453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.248481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.346 qpair failed and we were unable to recover it. 00:27:53.346 [2024-10-16 07:25:56.248631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.346 [2024-10-16 07:25:56.248761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.248804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.248925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.249201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.249460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.249699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.249826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.249974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.250214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.250433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.250677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.250828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.250958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.251375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.251657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.251825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.251954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.252217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.252530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.252821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.252974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.253114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.253363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.253641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.253894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.253982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.254007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.254132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.254252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.254278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.254373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.254722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.254775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.254918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.255180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.255445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.255713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.255891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.255980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.256270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.256586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.347 qpair failed and we were unable to recover it. 00:27:53.347 [2024-10-16 07:25:56.256898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.347 [2024-10-16 07:25:56.256990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.257188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.257506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.257786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.257935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.258044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.258323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.258633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.258806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.258894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.259174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.259479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.259687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.259859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.260008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.260269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.260463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.260694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.260870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.260993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.261231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.261554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.261711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.261872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.262173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.262490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.262776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.262945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.263049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.263269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.263530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.263759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.263904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.264025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.264319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.264565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.264818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.264931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.348 [2024-10-16 07:25:56.265065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.265187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.348 [2024-10-16 07:25:56.265212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.348 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.265334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.265481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.265506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.265599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.265765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.265790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.265937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.266181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.266416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.266652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.266799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.266930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.267165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.267375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.267671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.267831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.267934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.268253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.268497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.268794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.268961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.269080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.269343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.269588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.269838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.269972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.270087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.270388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.270724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.270914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.271033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.271231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.271536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.271772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.271963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.272111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.272399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.272687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.272817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.272940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.273088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.349 [2024-10-16 07:25:56.273112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.349 qpair failed and we were unable to recover it. 00:27:53.349 [2024-10-16 07:25:56.273200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.273483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.273839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.273958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.274108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.274390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.274710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.274859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.275001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.275254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.275527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.275850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.275996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.276119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.276454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.276704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.276891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.277046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.277306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.277607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.277760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.277885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.278190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.278453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.278779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.278938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.279036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.279277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.279597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.279907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.279997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.280023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.280168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.280286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.280309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.350 [2024-10-16 07:25:56.280459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.280578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.350 [2024-10-16 07:25:56.280603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.350 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.280724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.280852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.280877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.280998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.281229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.281446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.281738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.281868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.281989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.282324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.282642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.282886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.282976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.283125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.283333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.283602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.283769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.283918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.284235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.284502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.351 [2024-10-16 07:25:56.284753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.351 [2024-10-16 07:25:56.284860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.351 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.284947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.285178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.285394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.285655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.285874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.285998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.286116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.286404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.286665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.286905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.286990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.287138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.287432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.287747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.287908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.288039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.288334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.288622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.288795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.288959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.289191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.289455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.289764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.289876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.289970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.290116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.290141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.290274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.290395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.628 [2024-10-16 07:25:56.290420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.628 qpair failed and we were unable to recover it. 00:27:53.628 [2024-10-16 07:25:56.290537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.290627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.290652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.290758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.290909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.290933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.291024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.291252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.291518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.291815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.291956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.292103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.292366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.292708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.292873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.293032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.293317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.293628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.293783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.293902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.294155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.294448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.294714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.294901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.295040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.295263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.295523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.295693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.295862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.296141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.296397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.296641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.296787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.296930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.297203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.297437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.297703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.297837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.297962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.298253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.298544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.629 qpair failed and we were unable to recover it. 00:27:53.629 [2024-10-16 07:25:56.298864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.629 [2024-10-16 07:25:56.298980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.299100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.299389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.299631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.299793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.299921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.300255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.300597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.300844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.300973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.301070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.301371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.301591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.301747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.301902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.302172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.302433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.302722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.302930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.303031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.303279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.303542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.303778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.303890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.303994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.304256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.304480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.304689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.304864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.304983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.305231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.305512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.305757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.305880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.306017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.306284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.306648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.630 qpair failed and we were unable to recover it. 00:27:53.630 [2024-10-16 07:25:56.306878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.630 [2024-10-16 07:25:56.306995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.307142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.307399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.307641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.307886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.307998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.308112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.308349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.308574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.308785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.308935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.309051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.309368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.309686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.309813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.309931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.310151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.310414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.310775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.310897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.311094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.311393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.311716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.311892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.312015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.312352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.312671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.312825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.312919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.313301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.313567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.313745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.313860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.314126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.314393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.314609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.314867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.314984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.315009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.631 qpair failed and we were unable to recover it. 00:27:53.631 [2024-10-16 07:25:56.315169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.631 [2024-10-16 07:25:56.315260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.315285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.315432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.315564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.315590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.315703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.315823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.315850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.315999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.316277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.316587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.316858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.316974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.317119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.317402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.317666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.317841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.317962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.318297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.318600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.318795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.318945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.319058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.319327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.319603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.319901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.319996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.320168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.320423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.320754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.320884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.321058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.321320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.321570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.321875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.321995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.322020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.632 qpair failed and we were unable to recover it. 00:27:53.632 [2024-10-16 07:25:56.322113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.322255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.632 [2024-10-16 07:25:56.322279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.322431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.322521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.322546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.322637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.322762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.322788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.322928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.323245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.323550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.323719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.323869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.324251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.324589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.324716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.324866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.325139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.325404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.325679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.325806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.325945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.326260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.326559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.326841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.326962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.327061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.327329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.327629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.327778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.327882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.328194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.328475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.328738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.328912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.329016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.329278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.329509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.329759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.329897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.330015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.330313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.330647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.633 [2024-10-16 07:25:56.330800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.633 qpair failed and we were unable to recover it. 00:27:53.633 [2024-10-16 07:25:56.330896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.330991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.331141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.331424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.331684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.331837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.331970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.332294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.332580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.332765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.332860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.333230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.333528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.333841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.333960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.334111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.334433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.334694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.334819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.334948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.335261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.335601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.335794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.335951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.336268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.336584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.336762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.336912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.337205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.337450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.337691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.337830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.337920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.338269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.338553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.338785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.338916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.339037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.339137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.339163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.339288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.339428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.339452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.634 qpair failed and we were unable to recover it. 00:27:53.634 [2024-10-16 07:25:56.339543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.634 [2024-10-16 07:25:56.339657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.339682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.339790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.339915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.339940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.340114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.340410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.340716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.340842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.340964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.341266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.341564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.341845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.341975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.342104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.342427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.342744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.342877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.343029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.343282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.343549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.343710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.343834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.344210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.344494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.344823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.344952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.345105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.345381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.345670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.345806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.345950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.346192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.346508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.346831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.346984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.347084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.347379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.347724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.347876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.348012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.348173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.348201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.635 qpair failed and we were unable to recover it. 00:27:53.635 [2024-10-16 07:25:56.348334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.635 [2024-10-16 07:25:56.348478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.348503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.348622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.348745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.348771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.348916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.349236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.349437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.349736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.349882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.350051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.350299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.350554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.350832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.350979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.351130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.351427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.351739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.351878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.351993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.352185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.352391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.352673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.352791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.352936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.353272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.353591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.353749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.353905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.354205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.354524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.354810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.354947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.355088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.355417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.355684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.355849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.636 qpair failed and we were unable to recover it. 00:27:53.636 [2024-10-16 07:25:56.355981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.356109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.636 [2024-10-16 07:25:56.356138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.356254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.356378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.356403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.356550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.356722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.356761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.356882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.357410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.357695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.357875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.357974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.358248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.358508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.358795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.358969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.359121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.359438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.359741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.359903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.360018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.360299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.360615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.360798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.360945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.361166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.361472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.361750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.361898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.362028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.362307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.362606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.362759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.362904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.363149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.363427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.363713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.363871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.363997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.364301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.364554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.637 [2024-10-16 07:25:56.364852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.637 [2024-10-16 07:25:56.364969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.637 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.365089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.365393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.365701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.365868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.366001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.366260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.366510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.366843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.366964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.367094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.367356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.367709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.367909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.368041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.368362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.368596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.368773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.368913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.369171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.369438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.369740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.369900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.370049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.370350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.370586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.370782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.370904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.371224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.371503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.371796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.371954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.372087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.372335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.372621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.372790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.372898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.373200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.638 [2024-10-16 07:25:56.373456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.638 [2024-10-16 07:25:56.373610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.638 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.373715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.373806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.373830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.373968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.374226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.374549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.374821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.374961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.375125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.375408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.375647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.375841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.375942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.376238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.376525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.376835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.376980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.377107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.377353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.377635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.377813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.377928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.378201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.378493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.378767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.378881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.379001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.379282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.379564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.379722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.379891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.380187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.380432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.380722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.380890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.380985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.381315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.381585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.381749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.381877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.382019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.639 [2024-10-16 07:25:56.382043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.639 qpair failed and we were unable to recover it. 00:27:53.639 [2024-10-16 07:25:56.382165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.382445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.382692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.382830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.382949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.383196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.383421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.383711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.383902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.384049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.384333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.384616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.384743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.384890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.385182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.385458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.385751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.385907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.386051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.386394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.386650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.386838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.386963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.387207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.387442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.387660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.387826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.387946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.388193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.388474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.388766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.388922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.389039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.389299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.389576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.389867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.389994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.390149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.390292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.390317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.640 qpair failed and we were unable to recover it. 00:27:53.640 [2024-10-16 07:25:56.390444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.640 [2024-10-16 07:25:56.390560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.390584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.390703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.390823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.390850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.390983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.391279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.391560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.391697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.391877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.392169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.392469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.392739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.392866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.393023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.393369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.393560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.393856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.393991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.394173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.394499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.394761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.394873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.394975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.395269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.395525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.395833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.395981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.396190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.396510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.396815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.396981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.397097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.397350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.397671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.397828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.397938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.398084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.641 [2024-10-16 07:25:56.398111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.641 qpair failed and we were unable to recover it. 00:27:53.641 [2024-10-16 07:25:56.398235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.398522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.398805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.398993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.399095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.399378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.399615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.399791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.399930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.400187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.400414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.400707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.400852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.400948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.401276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.401490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.401796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.401925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.402034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.402337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.402649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.402784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.402935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.403218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.403499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.403772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.403924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.404013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.404292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.404525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.404799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.404914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.405014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.405303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.405540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.405870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.405991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.406015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.406158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.406304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.406348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.642 qpair failed and we were unable to recover it. 00:27:53.642 [2024-10-16 07:25:56.406514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.642 [2024-10-16 07:25:56.406676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.406704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.406836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.406958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.406982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.407127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.407368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.407613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.407805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.407950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.408209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.408448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.408761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.408887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.409017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.409324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.409605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.409803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.409936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.410246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.410522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.410764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.410942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.411102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.411408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.411675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.411913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.411998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.412142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.412392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.412739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.412853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.412991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.413271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.413479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.413719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.413872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.414008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.414269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.414554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.643 [2024-10-16 07:25:56.414821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.643 [2024-10-16 07:25:56.414996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.643 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.415115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.415373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.415657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.415790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.415965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.416291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.416576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.416840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.416962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.417077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.417366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.417621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.417772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.417932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.418230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.418503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.418791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.418955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.419083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.419366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.419643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.419804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.419938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.420217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.420538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.420897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.420993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.421160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.421461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.421715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.421872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.421962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.422191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.422418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.422750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.422886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.423055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.423209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.423236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.423409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.423507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.644 [2024-10-16 07:25:56.423531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.644 qpair failed and we were unable to recover it. 00:27:53.644 [2024-10-16 07:25:56.423655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.423774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.423801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.423891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.424220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.424527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.424804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.424936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.425027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.425280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.425587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.425880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.425979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.426141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.426444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.426738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.426861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.426979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.427230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.427434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.427693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.427892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.428055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.428372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.428644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.428786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.428928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.429238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.429525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.429829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.429985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.430113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.430424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.430687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.430832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.645 qpair failed and we were unable to recover it. 00:27:53.645 [2024-10-16 07:25:56.430947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.431068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.645 [2024-10-16 07:25:56.431093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.431202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.431468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.431804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.431929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.432055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.432295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.432618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.432896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.432985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.433151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.433396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.433678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.433846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.434008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.434274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.434580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.434890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.434995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.435186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.435399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.435601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.435903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.435990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.436095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.436329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.436674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.436831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.436931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.437210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.437454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.437775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.437959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.438086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.438360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.438671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.438905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.438997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.439023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.439145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.439319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.646 [2024-10-16 07:25:56.439347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.646 qpair failed and we were unable to recover it. 00:27:53.646 [2024-10-16 07:25:56.439484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.439582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.439606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.439754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.439865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.439890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.440023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.440320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.440617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.440866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.440977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.441121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.441412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.441642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.441785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.441943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.442178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.442424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.442691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.442842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.442983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.443285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.443540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.443874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.443998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.444125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.444387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.444706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.444866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.445000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.445241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.445525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.445855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.445971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.446116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.446343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.446621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.446875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.446991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.447146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.447411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.647 qpair failed and we were unable to recover it. 00:27:53.647 [2024-10-16 07:25:56.447748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.647 [2024-10-16 07:25:56.447867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.447893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.448050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.448353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.448689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.448839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.448950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.449283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.449560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.449795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.449935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.450241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.450524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.450833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.450946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.451055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.451342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.451678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.451811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.451977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.452203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.452512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.452833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.452953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.453095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.453408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.453703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.453859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.453951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.454227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.454497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.454747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.454914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.455060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.455373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.455687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.455818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.455949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.456229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.648 qpair failed and we were unable to recover it. 00:27:53.648 [2024-10-16 07:25:56.456517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.648 [2024-10-16 07:25:56.456631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.456765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.456863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.456891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.457025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.457300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.457637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.457784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.457974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.458311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.458573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.458860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.458979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.459124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.459360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.459596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.459769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.459916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.460125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.460428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.460714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.460848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.460955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.461202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.461539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.461844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.461987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.462191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.462458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.462724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.462907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.463062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.463401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.463672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.463837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.463962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.464099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.464123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.649 qpair failed and we were unable to recover it. 00:27:53.649 [2024-10-16 07:25:56.464244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.464401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.649 [2024-10-16 07:25:56.464430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.464574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.464691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.464717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.464857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.464965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.464993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.465124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.465400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.465673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.465822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.465965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.466271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.466566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.466818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.466965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.467079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.467330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.467596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.467782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.467913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.468196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.468486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.468751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.468914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.469064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.469307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.469511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.469820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.469940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.470086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.470335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.470680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.470874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.471008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.471326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.471586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.471761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.471941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.472258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.472519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.472781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.650 [2024-10-16 07:25:56.472988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.650 qpair failed and we were unable to recover it. 00:27:53.650 [2024-10-16 07:25:56.473117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.473405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.473702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.473849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.473990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.474323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.474632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.474786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.474895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.475177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.475437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.475732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.475916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.476078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.476281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.476593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.476849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.476995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.477132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.477365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.477670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.477850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.477974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.478291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.478518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.478810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.478972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.479130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.479455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.479700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.479877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.479989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.480275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.480618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.480737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.480849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.481195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.481501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.651 qpair failed and we were unable to recover it. 00:27:53.651 [2024-10-16 07:25:56.481791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.651 [2024-10-16 07:25:56.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.481976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.482089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.482338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.482628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.482810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.482980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.483311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.483598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.483763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.483907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.484150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.484455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.484774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.484921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.485079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.485384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.485666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.485850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.485956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.486254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.486556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.486827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.486973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.487125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.487443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.487679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.487851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.487989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.488264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.488532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.488810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.488950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.489086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.489338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.489632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.489769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.489909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.490144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.652 qpair failed and we were unable to recover it. 00:27:53.652 [2024-10-16 07:25:56.490438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.652 [2024-10-16 07:25:56.490583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.490708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.490820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.490848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.490986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.491278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.491499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.491778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.491938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.492106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.492387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.492675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.492860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.492989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.493288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.493575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.493860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.493986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.494112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.494441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.494710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.494874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.495036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.495321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.495722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.495926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.496100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.496412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.496745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.496918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.497060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.497301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.497561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.497709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.497886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.498223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.498459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.498774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.498947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.499079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.499218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.499252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.653 [2024-10-16 07:25:56.499410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.499562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.653 [2024-10-16 07:25:56.499590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.653 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.499737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.499871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.499903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.500040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.500397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.500738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.500888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.501060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.501376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.501714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.501907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.502060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.502374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.502691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.502864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.503029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.503355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.503699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.503852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.503956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.504216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.504540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.504880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.505198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.505505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.505706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.505900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.506232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.506574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.506752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.506898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.507180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.507465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.507758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.507916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.508058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.508169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.654 [2024-10-16 07:25:56.508201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.654 qpair failed and we were unable to recover it. 00:27:53.654 [2024-10-16 07:25:56.508362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.508511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.508553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.508716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.508869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.508904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.509044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.509340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.509702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.509838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.509962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.510245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.510543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.510706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.510899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.511200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.511537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.511855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.511982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.512144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.512421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.512722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.512913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.513031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.513304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.513556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.513775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.513914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.514218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.514524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.514803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.514931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.515067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.515356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.515666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.515892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.515984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.516132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.516441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.516694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.516852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.517043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.517173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.655 [2024-10-16 07:25:56.517203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.655 qpair failed and we were unable to recover it. 00:27:53.655 [2024-10-16 07:25:56.517343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.517441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.517473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.517586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.517696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.517737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.517866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.517993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.518465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.518760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.518954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.519091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.519380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.519674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.519833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.519935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.520221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.520494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.520682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.520858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.521214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.521534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.521806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.521973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.522143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.522478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.522789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.522912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.523060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.523337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.523658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.523829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.523949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.524240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.524570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.524724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.524877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.525216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.525492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.525837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.525978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.526110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.526248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.526277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.656 qpair failed and we were unable to recover it. 00:27:53.656 [2024-10-16 07:25:56.526394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.656 [2024-10-16 07:25:56.526491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.526518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.526652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.526763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.526795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.526912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.527192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.527480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.527774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.527912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.528081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.528410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.528664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.528837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.528987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.529308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.529581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.529781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.529924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.530252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.530572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.530898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.530996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.531160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.531411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.531710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.531919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.532060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.532334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.532589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.532822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.532918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.533239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.533611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.533798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.533931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.534535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.534820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.534945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.535092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.535219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.535248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.657 qpair failed and we were unable to recover it. 00:27:53.657 [2024-10-16 07:25:56.535402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.535566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.657 [2024-10-16 07:25:56.535597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.535726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.535871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.535906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.536082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.536392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.536688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.536902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.537044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.537381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.537674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.537877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.538000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.538283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.538652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.538818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.538944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.539278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.539598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.539897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.539984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.540137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.540419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.540757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.540899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.541022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.541332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.541644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.541810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.541917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.542234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.542522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.542814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.542968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.543107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.543241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.543274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.543411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.543530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.543561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.658 qpair failed and we were unable to recover it. 00:27:53.658 [2024-10-16 07:25:56.543672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.658 [2024-10-16 07:25:56.543782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.543817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.543914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.544156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.544484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.544815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.544956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.545093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.545357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.545661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.545792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.545913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.546210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.546525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.546781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.546918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.547068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.547351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.547662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.547789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.547935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.548240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.548539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.548724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.548852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.549179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.549490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.549750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.549887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.550027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.550345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.550567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.550848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.550996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.551101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.551460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.659 [2024-10-16 07:25:56.551688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.659 [2024-10-16 07:25:56.551850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.659 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.552013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.552330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.552609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.552755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.552921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.553217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.553463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.553718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.553899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.554028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.554341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.554633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.554804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.554895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.555017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.948 [2024-10-16 07:25:56.555047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.948 qpair failed and we were unable to recover it. 00:27:53.948 [2024-10-16 07:25:56.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.555475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.555722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.555880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.555991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.556294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.556647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.556791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.556932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.557265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.557787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.557955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.558264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.558575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.558751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.558873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.559180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.559497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.559782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.559916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.560061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.560394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.560724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.560909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.561030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.561405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.561710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.561905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.562018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.562297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.562522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.562836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.562974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.563143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.563478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.563799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.563971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.564093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.564204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.564234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.949 qpair failed and we were unable to recover it. 00:27:53.949 [2024-10-16 07:25:56.564326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.949 [2024-10-16 07:25:56.564476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.564510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.564637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.564734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.564761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.564892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.565200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.565495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.565789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.565915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.566066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.566361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.566631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.566826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.566973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.567262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.567589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.567765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.567876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.568193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.568506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.568779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.568934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.569086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.569441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.569696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.569875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.570017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.570355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.570669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.570825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.570947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.571214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.571538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.571887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.571986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.572126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.572492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.572857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.572982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.573110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.573204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.573230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.950 qpair failed and we were unable to recover it. 00:27:53.950 [2024-10-16 07:25:56.573361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.573464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.950 [2024-10-16 07:25:56.573493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.573634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.573767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.573797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.573911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.574226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.574567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.574754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.574890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.575201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.575535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.575784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.575919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.576072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.576355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.576667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.576827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.577004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.577319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.577606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.577776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.577908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.578143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.578444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.578716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.578903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.579055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.579317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.579595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.579882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.579988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.580164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.580446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.580719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.580873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.581008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.581348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.581681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.581832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.581974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.582123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.582150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.951 qpair failed and we were unable to recover it. 00:27:53.951 [2024-10-16 07:25:56.582274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.582419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.951 [2024-10-16 07:25:56.582453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.582611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.582741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.582769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.582918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.583220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.583557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.583741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.583905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.584214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.584527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.584835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.584962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.585117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.585398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.585690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.585875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.586018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.586345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.586663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.586834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.586966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.587229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.587561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.587800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.587961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.588112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.588476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.588796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.588955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.589072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.589391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.589693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.589857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.590146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.590175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.952 qpair failed and we were unable to recover it. 00:27:53.952 [2024-10-16 07:25:56.590308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.952 [2024-10-16 07:25:56.590446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.590475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.590582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.590683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.590712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.590885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.591178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.591518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.591698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.591884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.592256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.592568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.592717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.592898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.593229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.593532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.593811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.593930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.594100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.594419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.594787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.594960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.595105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.595366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.595687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.595866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.596005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.596354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.596684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.596864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.597015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.597335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.597622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.597802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.597947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.598281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.598596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.598741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.598924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.599281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.953 [2024-10-16 07:25:56.599571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.953 [2024-10-16 07:25:56.599753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.953 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.599895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.600224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.600562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.600810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.600954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.601050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.601356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.601611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.601770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.601909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.602251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.602533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.602796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.602957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.603082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.603353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.603723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.603893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.604064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.604359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.604575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.604868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.604990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.605188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.605467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.605768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.605934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.606059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.606336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.606615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.606788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.606948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.607292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.607581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.607770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.607948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.608213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.608552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.954 qpair failed and we were unable to recover it. 00:27:53.954 [2024-10-16 07:25:56.608830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.954 [2024-10-16 07:25:56.608926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.608956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.609096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.609386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.609696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.609833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.610007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.610244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.610565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.610902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.610997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.611169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.611511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.611772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.611920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.612098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.612460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.612790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.612949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.613081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.613370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.613699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.613857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.613994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.614352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.614639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.614784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.614929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.615194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.615541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.615876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.615997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.616218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.616541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.616794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.616943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.617063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.617302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.617572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.955 qpair failed and we were unable to recover it. 00:27:53.955 [2024-10-16 07:25:56.617806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.955 [2024-10-16 07:25:56.617977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.618070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.618310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.618582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.618806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.618957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.619080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.619316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.619553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.619792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.619905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.620020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.620316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.620520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.620754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.620892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.620977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.621214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.621423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.621721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.621842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.621936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.622203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.622497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.622737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.622854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.622941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.623176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.623398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.623683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.623802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.623919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.624212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.624447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.624685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.624838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.624966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.625086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.625112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.625201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.625306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.956 [2024-10-16 07:25:56.625332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.956 qpair failed and we were unable to recover it. 00:27:53.956 [2024-10-16 07:25:56.625477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.625565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.625590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.625713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.625813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.625838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.625927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.626164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.626410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.626650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.626873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.626992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.627117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.627355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.627646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.627882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.627977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.628123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.628344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.628579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.628794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.628937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.629086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.629296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.629556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.629824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.629974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.630122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.630482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.630760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.630924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.631097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.631240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.631289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.631436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf35600 is same with the state(5) to be set 00:27:53.957 [2024-10-16 07:25:56.631618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.631753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.631798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.631900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.632023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.632050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.632190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.632311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.632337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.957 qpair failed and we were unable to recover it. 00:27:53.957 [2024-10-16 07:25:56.632451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.957 [2024-10-16 07:25:56.632612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.632640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.632821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.632917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.632944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.633042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.633329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.633599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.633780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.633912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.634137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.634414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.634638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.634877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.634993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.635114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.635323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.635586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.635751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.635903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.636200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.636452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.636713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.636860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.637015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.637225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.637468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.637706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.637895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.638025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.638267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.638496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.638741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.638865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.638984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.639262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.639553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.639857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.639979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.640073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.640188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.640212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.958 qpair failed and we were unable to recover it. 00:27:53.958 [2024-10-16 07:25:56.640382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.640485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.958 [2024-10-16 07:25:56.640513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.640649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.640796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.640822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.640946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.641216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.641424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.641678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.641836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.641952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.642188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.642484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.642757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.642873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.642995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.643208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.643468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.643829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.643993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.644112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.644359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.644664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.644819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.644951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.645246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.645560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.645824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.645960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.646093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.646394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.646642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.646828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.646960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.647255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.647522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.647796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.647926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.648055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.648343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.648630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.959 [2024-10-16 07:25:56.648778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.959 qpair failed and we were unable to recover it. 00:27:53.959 [2024-10-16 07:25:56.648904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.649162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.649436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.649742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.649872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.650011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.650227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.650529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.650837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.650955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.651058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.651334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.651552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.651857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.651992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.652169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.652462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.652676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.652803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.652953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.653223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.653510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.653802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.653920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.654043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.654301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.654583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.654819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.654965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.655051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.655267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.655574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.655853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.655973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.656102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.656360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.656574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.960 qpair failed and we were unable to recover it. 00:27:53.960 [2024-10-16 07:25:56.656828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.960 [2024-10-16 07:25:56.656979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.657152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.657374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.657641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.657789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.657926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.658259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.658517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.658826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.658986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.659186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.659451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.659692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.659879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.660019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.660328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.660561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.660805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.660956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.661118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.661348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.661674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.661800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.661950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.662230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.662506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.662758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.662915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.663013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.663289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.663574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.663842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.663973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.664136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.664285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.961 qpair failed and we were unable to recover it. 00:27:53.961 [2024-10-16 07:25:56.664443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.664533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.961 [2024-10-16 07:25:56.664559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.664666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.664842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.664891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.665015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.665295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.665589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.665754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.665899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.666202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.666483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.666766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.666913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.667038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.667320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.667627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.667788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.667922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.668157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.668476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.668755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.668874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.668984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.669261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.669549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.669712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.669873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.670155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.670425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.670707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.670871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.670990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.671258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.671516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.671762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.671881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.672011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.672331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.672621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.672862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.962 [2024-10-16 07:25:56.672996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.962 qpair failed and we were unable to recover it. 00:27:53.962 [2024-10-16 07:25:56.673095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.673357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.673610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.673749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.673881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.674173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.674411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.674697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.674835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.674938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.675229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.675462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.675712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.675847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.675971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.676250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.676554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.676710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.676845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.677131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.677396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.677678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.677822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.677948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.678221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.678516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.678783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.678956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.679102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.679347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.679637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.679791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.679929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.680237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.680465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.680681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.680843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.680967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.681059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.681087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.963 qpair failed and we were unable to recover it. 00:27:53.963 [2024-10-16 07:25:56.681247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.963 [2024-10-16 07:25:56.681364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.681394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.681561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.681680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.681708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.681880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.681972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.682113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.682391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.682645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.682860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.682990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.683146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.683445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.683747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.683910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.684055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.684420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.684666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.684867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.685010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.685407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.685652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.685791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.685961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.686308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.686548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.686764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.686928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.687078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.687383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.687645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.687847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.688020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.688337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.688586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.688751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.688881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.689159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.689412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.689627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.689786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.964 [2024-10-16 07:25:56.689902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.690007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.964 [2024-10-16 07:25:56.690038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.964 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.690177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.690456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.690735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.690929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.691058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.691331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.691587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.691877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.691982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.692141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.692453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.692689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.692834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.692939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.693242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.693542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.693880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.693992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.694129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.694368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.694655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.694810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.694931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.695237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.695450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.695688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.695862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.695978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.696300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.696587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.696785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.696878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.697203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.965 [2024-10-16 07:25:56.697496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.965 [2024-10-16 07:25:56.697657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.965 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.697762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.697874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.697903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.697985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.698190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.698433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.698695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.698825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.698940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.699144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.699353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.699592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.699851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.699992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.700107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.700370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.700646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.700784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.700877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.701128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.701340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.701597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.701797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.701921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.702145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.702420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.702653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.702882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.702980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.703116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.703385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.703599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.703834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.703980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.704094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.704419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.704678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.704788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.704888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.705009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.705033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.966 qpair failed and we were unable to recover it. 00:27:53.966 [2024-10-16 07:25:56.705119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.966 [2024-10-16 07:25:56.705209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.705235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.705352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.705519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.705547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.705637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.705777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.705803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.705951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.706233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.706440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.706692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.706840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.706957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.707194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.707430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.707768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.707875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.707973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.708188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.708453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.708718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.708893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.709018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.709246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.709508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.709806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.709959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.710087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.710363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.710631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.710833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.710956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.711041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.711269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.711559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.711766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.711925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.712021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.712138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.712162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.712283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.712432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.712456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.967 qpair failed and we were unable to recover it. 00:27:53.967 [2024-10-16 07:25:56.712576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.967 [2024-10-16 07:25:56.712689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.712713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.712801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.712890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.712916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.713032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.713235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.713518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.713732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.713867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.713988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.714246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.714447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.714698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.714901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.714986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.715135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.715400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.715694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.715834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.715919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.716112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.716347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.716583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.716801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.716973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.717103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.717316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.717602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.717830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.717947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.718074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.718307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.718514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.718733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.718846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.718963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.719202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.719430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.968 [2024-10-16 07:25:56.719665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.968 [2024-10-16 07:25:56.719817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.968 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.719938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.720169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.720401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.720625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.720841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.720987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.721107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.721380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.721606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.721874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.721993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.722140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.722403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.722601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.722855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.722972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.723074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.723321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.723595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.723887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.723980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.724133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.724374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.724621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.724862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.724980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.725106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.725301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.725556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.725768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.725894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.725987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.726216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.726426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.726738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.726896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.727026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.727119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.727148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.969 qpair failed and we were unable to recover it. 00:27:53.969 [2024-10-16 07:25:56.727285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.969 [2024-10-16 07:25:56.727442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.727493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.727621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.727771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.727798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.727925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.728194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.728529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.728813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.728971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.729102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.729414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.729709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.729849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.729955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.730257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.730505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.730723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.730882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.731042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.731306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.731536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.731798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.731971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.732066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.732353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.732602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.732749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.732897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.733130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.733422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.733700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.733862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.733975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.734306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.734576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.970 [2024-10-16 07:25:56.734724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.970 qpair failed and we were unable to recover it. 00:27:53.970 [2024-10-16 07:25:56.734875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.734993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.735097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.735343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.735551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.735696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.735898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.736166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.736427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.736650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.736826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.736937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.737258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.737557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.737791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.737933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.738034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.738268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.738529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.738819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.738946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.739063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.739259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.739486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.739686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.739830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.739922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.740135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.740391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.740673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.740815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.740936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.741175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.741376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.741662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.741786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.741951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.742220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.971 [2024-10-16 07:25:56.742504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.971 [2024-10-16 07:25:56.742689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.971 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.742787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.742876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.742901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.743038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.743253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.743476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.743724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.743887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.744021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.744331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.744602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.744871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.744998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.745185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.745421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.745647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.745912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.745998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.746142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.746381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.746598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.746800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.746926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.747139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.747363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.747683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.747825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.747920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.748151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.748420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.748640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.748802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.748919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.749191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.749408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.749661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.749787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.749980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.750063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.750088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.750173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.750268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.750292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.972 qpair failed and we were unable to recover it. 00:27:53.972 [2024-10-16 07:25:56.750403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.972 [2024-10-16 07:25:56.750496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.750526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.750670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.750815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.750840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.750939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.751135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.751397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.751643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.751853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.751969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.752056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.752277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.752469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.752733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.752881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.752989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.753223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.753454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.753672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.753822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.753909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.754225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.754502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.754721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.754845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.754938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.755170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.755377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.755625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.755847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.755941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.756184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.756418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.756657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.756769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.756887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.757138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.757386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.757616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.973 qpair failed and we were unable to recover it. 00:27:53.973 [2024-10-16 07:25:56.757890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.973 [2024-10-16 07:25:56.757967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.757992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.758138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.758402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.758659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.758882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.758999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.759148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.759421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.759744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.759896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.760012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.760264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.760524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.760686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.760900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.761197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.761437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.761739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.761856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.762019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.762268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.762603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.762777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.762898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.763138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.763388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.763646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.763810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.763940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.764216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.764465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.764738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.764861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.764981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.765127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.765152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.974 qpair failed and we were unable to recover it. 00:27:53.974 [2024-10-16 07:25:56.765269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.974 [2024-10-16 07:25:56.765394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.765421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.765547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.765703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.765742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.765880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.765978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.766156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.766422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.766769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.766954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.767070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.767358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.767622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.767873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.767981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.768088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.768423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.768694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.768833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.768957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.769191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.769479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.769746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.769880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.770015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.770224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.770504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.770819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.770939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.771044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.771300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.771582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.771735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.771881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.772157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.772456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.772809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.772913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.773042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.773343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.773641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.975 [2024-10-16 07:25:56.773792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.975 qpair failed and we were unable to recover it. 00:27:53.975 [2024-10-16 07:25:56.773948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.774249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.774526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.774798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.774950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.775089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.775338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.775671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.775823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.775947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.776255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.776522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.776819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.776958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.777077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.777411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.777717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.777864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.778034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.778288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.778615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.778882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.778981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.779106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.779367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.779642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.779802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.779927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.780206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.780523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.780801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.780930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.781046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.781317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.781598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.781758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.781901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.782179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.976 qpair failed and we were unable to recover it. 00:27:53.976 [2024-10-16 07:25:56.782463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.976 [2024-10-16 07:25:56.782592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.782725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.782902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.782926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.783034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.783304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.783574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.783880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.783984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.784155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.784417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.784716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.784865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.785024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.785269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.785548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.785818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.785936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.786050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.786245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.786515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.786822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.786964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.787102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.787381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.787738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.787879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.788000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.788238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.788473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.788718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.788878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.788967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.789224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.789491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.789768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.789890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.790028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.790291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.790556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.977 qpair failed and we were unable to recover it. 00:27:53.977 [2024-10-16 07:25:56.790858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.977 [2024-10-16 07:25:56.790952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.790977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.791057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.791352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.791637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.791823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.791910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.792196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.792490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.792743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.792901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.792997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.793262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.793487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.793767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.793894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.793993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.794209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.794472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.794701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.794854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.795026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.795303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.795571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.795906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.795997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.796470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.796767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.796889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.797017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.797302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.797495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.797770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.797892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.978 qpair failed and we were unable to recover it. 00:27:53.978 [2024-10-16 07:25:56.797997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.798121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.978 [2024-10-16 07:25:56.798145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.798228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.798478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.798752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.798895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.799017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.799294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.799578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.799816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.799990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.800140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.800386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.800657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.800818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.800921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.801157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.801443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.801696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.801867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.801983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.802256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.802547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.802829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.802968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.803112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.803348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.803618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.803786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.803899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.804169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.804487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.804762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.804943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.805098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.805359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.805647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.805772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.805918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.806051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.806079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.806228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.806369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.806410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.979 qpair failed and we were unable to recover it. 00:27:53.979 [2024-10-16 07:25:56.806554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.979 [2024-10-16 07:25:56.806681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.806708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.806842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.806968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.806995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.807158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.807361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.807654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.807841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.807986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.808234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.808465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.808762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.808874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.809012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.809333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.809626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.809796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.809969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.810217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.810478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.810757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.810903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.811037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.811327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.811580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.811750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.811856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.812178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.812431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.812769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.812882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.812995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.813244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.813478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.813742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.813855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.813967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.814271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.814657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.814823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.980 [2024-10-16 07:25:56.814944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.815103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.980 [2024-10-16 07:25:56.815130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.980 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.815231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.815388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.815415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.815611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.815734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.815777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.815900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.816192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.816457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.816686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.816837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.816915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.817218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.817438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.817666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.817814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.817923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.818208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.818485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.818738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.818886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.818974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.819230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.819515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.819777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.819972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.820104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.820396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.820645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.820839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.820944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.821229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.821482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.821780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.821976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.822118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.822365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.822689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.822851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.823015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.823131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.823156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.823318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.823439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.823467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.981 qpair failed and we were unable to recover it. 00:27:53.981 [2024-10-16 07:25:56.823607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.981 [2024-10-16 07:25:56.823706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.823742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.823859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.823977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.824145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.824367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.824633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.824798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.824964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.825247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.825562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.825824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.825966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.826118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.826362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.826597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.826863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.826995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.827170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.827452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.827723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.827910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.828033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.828298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.828603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.828774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.828898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.829158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.829423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.829656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.829809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.829941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.830225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.830519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.830799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.830951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.831050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.831342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.831621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.831789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.831925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.832028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.982 [2024-10-16 07:25:56.832055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.982 qpair failed and we were unable to recover it. 00:27:53.982 [2024-10-16 07:25:56.832217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.832481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.832758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.832914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.833025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.833305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.833613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.833792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.833910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.834103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.834343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.834605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.834856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.834985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.835122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.835448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.835724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.835888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.835989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.836260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.836519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.836789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.836933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.837054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.837306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.837590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.837786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.837917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.838164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.838410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.838703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.838818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.838918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.839048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.839076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.839203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.839308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.839337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.983 qpair failed and we were unable to recover it. 00:27:53.983 [2024-10-16 07:25:56.839481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.983 [2024-10-16 07:25:56.839596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.839620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.839737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.839867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.839899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.840033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.840301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.840528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.840868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.840990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.841155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.841426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.841699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.841844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.841975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.842216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.842505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.842768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.842917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.843008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.843334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.843664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.843811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.843926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.844193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.844525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.844829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.844974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.845083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.845362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.845603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.845770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.845881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.846203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.846479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.846754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.846886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.847034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.847253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.847587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.847773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.984 [2024-10-16 07:25:56.847910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.848024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.984 [2024-10-16 07:25:56.848048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.984 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.848169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.848453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.848767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.848912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.849027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.849264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.849524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.849827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.849985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.850113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.850412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.850665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.850820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.850928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.851222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.851499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.851776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.851935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.852071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.852314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.852588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.852760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.852885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.853162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.853473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.853770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.853942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.854053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.854390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.854682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.854862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.854997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.855282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.855609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.855753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.855894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.856177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.856425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.985 qpair failed and we were unable to recover it. 00:27:53.985 [2024-10-16 07:25:56.856712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.985 [2024-10-16 07:25:56.856831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.856936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.857188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.857495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.857816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.857939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.858055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.858251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.858552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.858765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.858882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.859013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.859282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.859507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.859817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.859974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.860101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.860233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.860258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.860376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.860463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.986 [2024-10-16 07:25:56.860487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:53.986 qpair failed and we were unable to recover it. 00:27:53.986 [2024-10-16 07:25:56.860580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.288 [2024-10-16 07:25:56.860711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.288 [2024-10-16 07:25:56.860744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.288 qpair failed and we were unable to recover it. 00:27:54.288 [2024-10-16 07:25:56.860849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.288 [2024-10-16 07:25:56.860968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.288 [2024-10-16 07:25:56.860996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.288 qpair failed and we were unable to recover it. 00:27:54.288 [2024-10-16 07:25:56.861140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.288 [2024-10-16 07:25:56.861248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.861358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.861614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.861874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.861976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.862122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.862360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.862617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.862771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.862883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.864280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.864509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.864822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.864962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.865053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.865263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.865531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.865779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.865897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.866048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.866290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.866515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.866755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.866900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.867050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.867282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.867532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.867772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.867884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.867980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.868247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.868434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.868676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.868851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.868942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.869166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.869397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.289 [2024-10-16 07:25:56.869608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.289 [2024-10-16 07:25:56.869735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.289 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.869839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.869956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.869981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.870143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.870370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.870604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.870871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.870983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.871101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.871335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.871618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.871871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.871993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.872105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.872321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.872639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.872864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.872999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.873081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.873382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.873618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.873911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.873998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.874025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.874201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.874284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.874309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.874428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.875254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.875526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.875780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.875958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.876045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.876298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.876569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.876821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.876964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.877066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.877293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.877539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.877770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.877911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.290 qpair failed and we were unable to recover it. 00:27:54.290 [2024-10-16 07:25:56.877992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.290 [2024-10-16 07:25:56.878125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.878245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.878481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.878799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.878909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.879029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.879319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.879600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.879797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.879940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.880068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.880315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.880600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.880870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.880979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.881080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.881303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.881596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.881871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.881988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.882184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.882432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.882684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.882814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.882914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.883183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.883441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.883713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.883845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.883973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.884231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.884448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.884722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.884940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.885029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.885311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.885628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.885904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.885996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.291 [2024-10-16 07:25:56.886021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.291 qpair failed and we were unable to recover it. 00:27:54.291 [2024-10-16 07:25:56.886140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.886503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.886748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.886863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.886978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.887292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.887575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.887883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.887997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.888105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.888369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.888635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.888800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.888955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.889247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.889521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.889838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.889987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.890126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.890361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.890653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.890808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.890914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.891198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.891486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.891788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.891909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.892047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.892315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.892595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.892811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.892929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.893075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.893376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.893664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.893793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.893930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.894032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.894061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.894205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.894344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.894369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.292 qpair failed and we were unable to recover it. 00:27:54.292 [2024-10-16 07:25:56.894511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.292 [2024-10-16 07:25:56.894606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.894634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.894774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.894906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.894933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.895102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.895394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.895651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.895805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.895930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.896207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.896476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.896776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.896886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.896980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.897208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.897563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.897779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.897893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.898013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.898370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.898608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.898820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.898955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.899110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.899399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.899662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.899799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.899935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.900255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.900549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.900830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.900937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.901115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.901254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.901278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.293 qpair failed and we were unable to recover it. 00:27:54.293 [2024-10-16 07:25:56.901395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.293 [2024-10-16 07:25:56.901473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.901497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.901679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.901793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.901818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.901985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.902290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.902612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.902858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.902975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.903110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.903470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.903735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.903924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.904018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.904317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.904563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.904888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.904995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.905140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.905433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.905707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.905849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.905988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.906312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.906581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.906856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.906973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.907111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.907404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.907699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.907831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.907968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.908224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.908466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.908668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.908883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.908997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.909277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.909581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.294 [2024-10-16 07:25:56.909837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.294 [2024-10-16 07:25:56.909984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.294 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.910098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.910402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.910668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.910829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.910962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.911230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.911551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.911848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.911961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.912055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.912326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.912652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.912818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.912919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.913176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.913485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.913776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.913932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.914060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.914306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.914534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.914782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.914946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.915096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.915345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.915673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.915802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.915943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.916178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.916418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.916658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.916834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.916956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.917241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.917499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.917790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.917933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.918021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.918138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.918179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.295 qpair failed and we were unable to recover it. 00:27:54.295 [2024-10-16 07:25:56.918355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.918438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.295 [2024-10-16 07:25:56.918463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.918582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.918708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.918751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.918850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.918970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.918998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.919151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.919429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.919712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.919877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.919999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.920326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.920562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.920713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.920914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.921194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.921513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.921848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.921953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.922062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.922376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.922655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.922823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.922957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.923272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.923579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.923772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.923910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.923999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.924284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.924609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.924768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.924894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.925155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.925467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.925724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.925886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.926002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.926266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.926557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.296 [2024-10-16 07:25:56.926842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.296 [2024-10-16 07:25:56.926982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.296 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.927093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.927418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.927666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.927821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.927942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.928229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.928499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.928743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.928910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.929020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.929264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.929470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.929773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.929933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.930056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.930315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.930571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.930843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.930989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.931082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.931327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.931646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.931899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.931993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.932194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.932474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.932734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.932876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.932978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.933262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.933516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.933765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.933901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.297 qpair failed and we were unable to recover it. 00:27:54.297 [2024-10-16 07:25:56.933998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.297 [2024-10-16 07:25:56.934121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.934287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.934535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.934842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.934967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.935062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.935288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.935588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.935801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.935915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.936038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.936295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.936499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.936789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.936930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.937056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.937301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.937553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.937862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.937977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.938083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.938337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.938561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.938827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.938968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.939076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.939345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.939594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.939857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.939997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.940118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.940389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.940640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.940808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.940955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.941072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.941095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.298 [2024-10-16 07:25:56.941226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.941349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.298 [2024-10-16 07:25:56.941375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.298 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.941531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.941614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.941637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.941736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.941851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.941874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.941970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.942099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.942122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.942258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.943231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.943487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.943700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.943826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.943916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.944165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.944456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.944697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.944820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.944914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.945063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.945088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.945194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.945311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.945335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.946306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.946457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.946486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.946654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.946789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.946818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.946952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.947071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.947095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.947213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.947296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.947330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.948093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.948386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.948653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.948772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.948921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.949200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.949515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.949813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.949938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.950068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.950378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.950592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.950848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.950997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.299 qpair failed and we were unable to recover it. 00:27:54.299 [2024-10-16 07:25:56.951140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.299 [2024-10-16 07:25:56.951225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.951346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.951618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.951896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.951988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.952147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.952412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.952661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.952801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.952945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.953104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.953129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.954082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.954440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.954740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.954890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.955035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.955338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.955586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.955807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.955914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.956124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.956360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.956600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.956853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.956985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.957149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.957469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.957758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.957891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.957988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.958389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.958701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.958933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.959073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.959306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.959526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.959776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.959912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.960005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.960153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.300 [2024-10-16 07:25:56.960178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.300 qpair failed and we were unable to recover it. 00:27:54.300 [2024-10-16 07:25:56.960313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.960468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.960500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.960658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.960777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.960802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.960901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.960987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.961131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.961391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.961783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.961929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.962047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.962326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.962612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.962786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.962986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.963287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.963526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.963850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.963974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.964148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.964463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.964767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.964911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.965074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.965354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.965619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.965863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.965971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.966128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.966465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.966708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.966848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.966947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.967230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.967484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.967740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.967875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.967976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.968112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.968136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.301 qpair failed and we were unable to recover it. 00:27:54.301 [2024-10-16 07:25:56.968254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.301 [2024-10-16 07:25:56.968415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.968443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.968577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.968705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.968771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.968891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.969189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.969543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.969830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.969972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.970130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.970421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.970736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.970860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.971651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.971823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.971850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.972613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.972829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.972856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.973551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.973690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.973719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.973857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.973950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.973975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.974119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.974419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.974639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.974824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.974942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.975155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.975399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.975633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.975879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.975999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.976127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.976386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.976621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.976797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.976892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.977205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.977495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.302 [2024-10-16 07:25:56.977650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.302 qpair failed and we were unable to recover it. 00:27:54.302 [2024-10-16 07:25:56.977795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.977893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.977918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.978055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.978340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.978661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.978783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.978924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.979188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.979489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.979705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.979836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.979934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.980188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.980465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.980708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.980835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.980931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.981173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.981403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.981675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.981796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.981916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.982127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.982363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.982592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.982848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.982970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.983098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.983338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.983596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.983810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.983956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.984058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.984146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.984170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.984271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.984388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.984413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.303 qpair failed and we were unable to recover it. 00:27:54.303 [2024-10-16 07:25:56.984514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.303 [2024-10-16 07:25:56.984608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.984634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.984714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.984913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.984938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.985057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.985295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.985572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.985849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.985994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.986120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.986438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.986735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.986855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.986949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.987209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.987419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.987681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.987816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.987930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.988199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.988714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.988843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.988938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.989179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.989384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.989620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.989806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.989909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.990136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.990363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.990596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.990771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.990969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.991248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.991481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.991750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.991866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.991962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.992053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.992077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.992207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.992327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.304 [2024-10-16 07:25:56.992354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.304 qpair failed and we were unable to recover it. 00:27:54.304 [2024-10-16 07:25:56.992511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.992655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.992680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.992794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.992889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.992915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.992996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.993291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.993586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.993830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.993951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.994037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.994405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.994697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.994821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.994913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.995205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.995502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.995796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.995914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.996025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.996297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.996665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.996792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.996914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.997121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.997407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.997667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.997894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.997977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.998095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.998338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.998625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.998882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.998996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.999123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.999362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.305 qpair failed and we were unable to recover it. 00:27:54.305 [2024-10-16 07:25:56.999648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.305 [2024-10-16 07:25:56.999759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:56.999785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:56.999899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:56.999996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.000139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.000453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.000750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.000876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.001000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.001208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.001448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.001670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.001850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.001942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.002179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.002456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.002732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.002846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.002941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.003208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.003450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.003741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.003854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.003945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.004181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.004420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.004736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.004844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.004942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.005215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.005451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.005755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.005914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.006005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.006137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.006162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.006308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.006427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.306 [2024-10-16 07:25:57.006453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.306 qpair failed and we were unable to recover it. 00:27:54.306 [2024-10-16 07:25:57.006545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.006665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.006690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.006858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.006953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.006978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.007079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.007316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.007550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.007804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.007929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.008026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.008339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.008580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.008803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.008923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.009010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.009359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.009660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.009849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.009937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.010178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.010410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.010711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.010862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.011059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.011354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.011605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.011843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.011990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.012109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.012390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.012648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.012787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.012868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.013181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.013470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.013803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.013935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.014083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.014287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.014314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.014454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.014549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.307 [2024-10-16 07:25:57.014574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.307 qpair failed and we were unable to recover it. 00:27:54.307 [2024-10-16 07:25:57.014661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.014857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.014883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.014998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.015259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.015547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.015895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.015984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.016142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.016442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.016770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.016937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.017063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.017337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.017601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.017815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.017959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.018086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.018390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.018674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.018820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.018910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.019142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.019415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.019675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.019880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.019977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.020278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.020509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.020782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.020945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.021076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.021335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.021664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.021805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.022007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.022291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.022550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.022826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.022974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.308 qpair failed and we were unable to recover it. 00:27:54.308 [2024-10-16 07:25:57.023137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.023263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.308 [2024-10-16 07:25:57.023291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.023492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.023608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.023633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.023737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.023860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.023886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.024018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.024307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.024542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.024844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.024985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.025130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.025389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.025702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.025837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.025986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.026177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.026452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.026776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.026917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.027058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.027349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.027618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.027768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.027882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.028166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.028444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.028801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.028948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.029125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.029403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.029686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.029811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.029905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.030170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.030464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.030777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.030933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.031060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.031343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.031571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.031748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.309 qpair failed and we were unable to recover it. 00:27:54.309 [2024-10-16 07:25:57.031858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.309 [2024-10-16 07:25:57.032026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.032186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.032470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.032810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.032937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.033099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.033339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.033673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.033854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.033974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.034293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.034527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.034826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.034954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.035098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.035394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.035712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.035835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.035979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.036307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.036608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.036777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.036955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.037254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.037609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.037801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.037904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.038215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.038506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.038791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.038897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.039025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.039303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.039602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.039888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.039990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.040143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.040433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.040711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.310 [2024-10-16 07:25:57.040919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.310 qpair failed and we were unable to recover it. 00:27:54.310 [2024-10-16 07:25:57.041033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.041304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.041570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.041847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.041996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.042160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.042441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.042767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.042910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.043073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.043425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.043697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.043848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.043964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.044189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.044448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.044769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.044912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.045067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.045398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.045651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.045813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.045916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.046204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.046523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.046799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.046970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.047060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.047341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.047633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.047813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.047909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.048210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.048487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.311 [2024-10-16 07:25:57.048651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.311 qpair failed and we were unable to recover it. 00:27:54.311 [2024-10-16 07:25:57.048762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.048883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.048908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.049019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.049301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.049567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.049725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.049879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.050177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.050398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.050631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.050796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.050891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.051153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.051394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.051656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.051829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.051954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.052260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.052564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.052866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.052984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.053107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.053341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.053635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.053875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.053984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.054114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.054391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.054663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.054827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.054968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.055272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.055535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.055822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.055965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.056117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.056407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.056667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.056819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.312 [2024-10-16 07:25:57.056943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.057070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.312 [2024-10-16 07:25:57.057106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.312 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.057253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.057510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.057816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.057962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.058046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.058320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.058574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.058723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.058927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.059192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.059438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.059677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.059836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.059958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.060225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.060471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.060812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.060920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.061035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.061307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.061621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.061775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.061941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.062161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.062461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.062732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.062874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.062979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.063344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.063688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.063864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.063987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.064243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.064514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.064785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.064928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.065043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.065162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.065189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.065306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.065420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.065444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.313 qpair failed and we were unable to recover it. 00:27:54.313 [2024-10-16 07:25:57.065566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.313 [2024-10-16 07:25:57.065652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.065676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.065809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.065894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.065922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.066043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.066278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.066572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.066836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.066957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.067064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.067351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.067676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.067826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.067998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.068320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.068647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.068826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.068925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.069147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.069430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.069712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.069884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.070022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.070266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.070572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.070871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.070986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.071112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.071390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.071721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.071920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.072027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.072317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.072627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.072807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.072958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.073244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.073518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.073862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.073980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.074006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.074150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.074322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.314 [2024-10-16 07:25:57.074347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.314 qpair failed and we were unable to recover it. 00:27:54.314 [2024-10-16 07:25:57.074492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.074635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.074662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.074801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.074896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.074922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.075047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.075321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.075632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.075800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.075927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.076163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.076424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.076659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.076814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.076969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.077262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.077542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.077868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.077996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.078111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.078416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.078806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.078959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.079099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.079369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.079651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.079888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.079977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.080133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.080382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.080613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.080766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.080900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.081176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.081503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.081803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.315 [2024-10-16 07:25:57.081927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.315 qpair failed and we were unable to recover it. 00:27:54.315 [2024-10-16 07:25:57.082040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.082346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.082632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.082756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.082923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.083206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.083497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.083829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.083983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.084135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.084393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.084660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.084815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.084923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.085221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.085630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.085790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.085912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.086175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.086476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.086751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.086906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.087049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.087351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.087613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.087732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.087857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.088206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.088443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.088723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.088888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.089030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.089308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.089575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.089854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.089973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.090124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.090405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.316 [2024-10-16 07:25:57.090733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.316 [2024-10-16 07:25:57.090877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.316 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.091023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.091279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.091564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.091911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.091999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.092163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.092396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.092657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.092774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.092922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.093211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.093512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.093778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.093967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.094102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.094361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.094612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.094809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.094928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.095184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.095508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.095862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.095995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.096166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.096386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.096625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.096888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.096998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.097168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.097463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.097847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.097979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.098076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.098448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.098742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.098886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.098995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.099146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.099173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.099306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.099407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.099436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.317 qpair failed and we were unable to recover it. 00:27:54.317 [2024-10-16 07:25:57.099587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.317 [2024-10-16 07:25:57.099743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.099768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.099888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.100208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.100481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.100722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.100896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.101046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.101276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.101529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.101780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.101930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.102063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.102372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.102629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.102864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.102984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.103097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.103436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.103739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.103923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.104042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.104300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.104576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.104855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.104979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.105136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.105385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.105691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.105832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.105927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.106200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.106431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.106695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.106872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.106997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.107309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.107588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.107836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.318 [2024-10-16 07:25:57.107974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.318 qpair failed and we were unable to recover it. 00:27:54.318 [2024-10-16 07:25:57.108085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.108303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.108619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.108762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.108898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.109211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.109478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.109717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.109918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.110051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.110320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.110624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.110799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.110896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.111248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.111489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.111789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.111914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.112058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.112280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.112635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.112999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.113123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.113357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.113632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.113790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.113922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.114197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.114431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.114743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.114924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.115045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.115174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.319 [2024-10-16 07:25:57.115215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.319 qpair failed and we were unable to recover it. 00:27:54.319 [2024-10-16 07:25:57.115338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.115431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.115456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.115565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.115716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.115750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.115855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.115985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.116133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.116405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.116668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.116797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.116922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.117187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.117499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.117820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.117993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.118159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.118421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.118651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.118766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.118863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.119149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.119491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.119761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.119909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.120038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.120319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.120653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.120899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.121055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.121401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.121629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.121794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.121897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.122189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.122443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.122705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.122870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.122987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.123243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.123510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.320 [2024-10-16 07:25:57.123773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.320 [2024-10-16 07:25:57.123921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.320 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.124053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.124386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.124736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.124897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.125029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.125339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.125625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.125837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.125954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.126232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.126491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.126751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.126912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.127112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.127423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.127768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.127968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.128105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.128419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.128721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.128853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.128989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.129320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.129607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.129855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.129982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.130117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.130380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.130664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.130836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.130983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.131231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.131502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.131799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.131948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.132101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.132418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.132718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.321 [2024-10-16 07:25:57.132872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.321 qpair failed and we were unable to recover it. 00:27:54.321 [2024-10-16 07:25:57.132989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.133276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.133600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.133865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.133992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.134130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.134415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.134736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.134890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.135034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.135324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.135571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.135725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.135875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.136150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.136442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.136746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.136941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.137084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.137305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.137613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.137740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.137886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.138194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.138513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.138840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.138986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.139109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.139344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.139626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.139759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.139927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.140230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.140471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.140813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.140995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.141125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.141384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.322 qpair failed and we were unable to recover it. 00:27:54.322 [2024-10-16 07:25:57.141651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.322 [2024-10-16 07:25:57.141814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.141922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.142246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.142570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.142799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.142931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.143068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.143285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.143497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.143738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.143857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.144021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.144283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.144552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.144789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.144978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.145108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.145356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.145588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.145873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.145997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.146164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.146433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.146666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.146821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.146932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.147187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.147466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.147793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.147935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.148075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.148361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.148634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.148782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.148935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.149213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.149490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.149795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.149979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.323 qpair failed and we were unable to recover it. 00:27:54.323 [2024-10-16 07:25:57.150143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.323 [2024-10-16 07:25:57.150247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.150274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.150384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.150537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.150562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.150718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.150824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.150849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.150982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.151218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.151487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.151779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.151934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.152097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.152427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.152723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.152929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.153076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.153302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.153597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.153864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.153985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.154191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.154499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.154793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.154926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.155096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.155378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.155705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.155857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.155983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.156302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.156569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.156743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.156909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.157230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.157576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.157721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.157903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.158077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.324 [2024-10-16 07:25:57.158102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.324 qpair failed and we were unable to recover it. 00:27:54.324 [2024-10-16 07:25:57.158229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.158522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.158781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.158936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.159034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.159274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.159582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.159885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.159979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.160094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.160355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.160695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.160908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.161017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.161309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.161567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.161766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.161945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.162234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.162447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.162734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.162847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.162980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.163300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.163652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.163798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.163940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.164232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.164523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.164755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.164910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.165055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.165402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.165672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.165835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.165942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.166250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.166522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.325 qpair failed and we were unable to recover it. 00:27:54.325 [2024-10-16 07:25:57.166804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.325 [2024-10-16 07:25:57.166905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.166932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.167039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.167272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.167556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.167875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.167999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.168181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.168469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.168769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.168904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.169301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.169579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.169762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.169883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.170169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.170511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.170740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.170935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.171081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.171391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.171741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.171894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.172003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.172272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.172551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.172706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.172894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.173255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.173472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.173760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.173956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.174108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.174344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.174626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.174788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.174932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.175157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.326 [2024-10-16 07:25:57.175395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.326 [2024-10-16 07:25:57.175555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.326 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.175669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.175766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.175791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.175948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.176280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.176599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.176751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.176928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.177225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.177591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.177806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.177951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.178265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.178587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.178738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.178920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.179226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.179464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.179717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.179873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.180009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.180264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.180520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.180822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.180986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.181144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.181381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.181594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.181781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.181888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.182137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.182474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.182805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.182951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.183064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.183325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.183595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.183863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.183993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.327 [2024-10-16 07:25:57.184110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.184208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.327 [2024-10-16 07:25:57.184237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.327 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.184387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.184530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.184555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.184700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.184866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.184893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.185060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.185346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.185618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.185903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.185999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.186145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.186360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.186595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.186764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.186898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.187140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.187359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.187601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.187749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.187923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.188136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.188376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.188583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.188828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.188942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.189031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.189249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.189474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.189739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.189884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.189980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.190224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.190468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.190678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.190844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.328 [2024-10-16 07:25:57.190971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.191069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.328 [2024-10-16 07:25:57.191097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.328 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.191217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.191446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.191643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.191787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.191886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.192169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.192464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.192691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.192842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.192929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.193164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.193371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.193611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.193882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.193999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.194152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.194389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.194649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.194812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.194979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.195215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.195449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.195674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.195820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.195905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.196216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.196515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.196784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.196943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.197077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.197339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.329 [2024-10-16 07:25:57.197573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.329 [2024-10-16 07:25:57.197746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.329 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.197873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.197974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.198121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.198326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.198610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.198864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.198977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.199094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.199376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.199608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.199857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.199987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.200136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.200350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.200601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.200867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.200975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.201095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.201328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.201563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.201850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.201994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.202105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.202385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.202661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.202803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.202914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.203209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.203437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.203623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.203784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.203889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.204177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.204427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.204713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.204903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.205024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.205147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.205172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.205280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.205436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.612 [2024-10-16 07:25:57.205464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.612 qpair failed and we were unable to recover it. 00:27:54.612 [2024-10-16 07:25:57.205597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.205759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.205787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.205905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.206188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.206466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.206746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.206888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.206984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.207340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.207667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.207795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.207911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.208209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.208547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.208785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.208964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.209086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.209353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.209672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.209840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.209959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.210285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.210549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.210740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.210886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.211133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.211395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.211659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.211806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.211974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.212195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.212450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.212743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.212904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.213038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.213324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.213618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.213765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.213937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.214114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.214169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.613 qpair failed and we were unable to recover it. 00:27:54.613 [2024-10-16 07:25:57.214324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.613 [2024-10-16 07:25:57.214492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.214516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.214635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.214717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.214753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.214879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.215155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.215449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.215711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.215832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.215946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.216204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.216439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.216742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.216878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.217016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.217332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.217656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.217792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.217967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.218297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.218579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.218887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.218980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.219104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.219359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.219661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.219835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.220005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.220342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.220643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.220790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.220911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.221197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.221543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.221810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.221960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.222094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.222364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.222642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.222803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.614 [2024-10-16 07:25:57.222934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.223056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.614 [2024-10-16 07:25:57.223083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.614 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.223187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.223405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.223691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.223833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.223974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.224269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.224618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.224792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.224938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.225209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.225488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.225817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.225962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.226148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.226432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.226726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.226878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.227017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.227311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.227568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.227808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.227951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.228118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.228389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.228662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.228789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.228923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.229204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.229412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.229673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.229794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.229883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.230182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.230493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.230798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.230971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.231078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.231209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.231238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.615 qpair failed and we were unable to recover it. 00:27:54.615 [2024-10-16 07:25:57.231386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.231510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.615 [2024-10-16 07:25:57.231537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.231672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.231769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.231795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.231943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.232273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.232558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.232817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.232943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.233075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.233354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.233635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.233816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.233921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.234215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.234507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.234781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.234935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.235044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.235292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.235584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.235741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.235864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.236216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.236417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.236714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.236865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.236972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.237264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.237573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.237866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.237997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.238157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.238456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.238733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.616 [2024-10-16 07:25:57.238858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.616 qpair failed and we were unable to recover it. 00:27:54.616 [2024-10-16 07:25:57.239029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.239303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.239628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.239817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.239921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.240218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.240521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.240823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.240985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.241157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.241438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.241732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.241863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.241995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.242283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.242619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.242870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.242987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.243140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.243450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.243767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.243911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.244087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.244416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.244714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.244840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.244957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.245242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.245510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.245803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.245982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.246098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.246335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.246650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.246896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.247031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.247308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.247629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.247791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.617 qpair failed and we were unable to recover it. 00:27:54.617 [2024-10-16 07:25:57.247909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.617 [2024-10-16 07:25:57.248037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.248171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.248423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.248692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.248805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.248992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.249238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.249522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.249840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.249954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.250101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.250488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.250793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.250963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.251083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.251333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.251601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.251706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.251851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.252184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.252478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.252744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.252901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.253023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.253355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.253645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.253809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.253936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.254200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.254481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.254773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.254937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.255026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.255314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.255565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.255861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.255978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.256004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.256110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.256244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.256273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.618 qpair failed and we were unable to recover it. 00:27:54.618 [2024-10-16 07:25:57.256398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.256508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.618 [2024-10-16 07:25:57.256536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.256651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.256801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.256826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.256973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.257190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.257532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.257785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.257912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.257999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.258264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.258521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.258832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.258946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.259037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.259294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.259585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.259874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.259989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.260160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.260415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.260705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.260847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.260942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.261146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.261470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.261676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.261844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.261954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.262227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.262457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.262720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.262860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.263004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.263295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.263559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.263800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.263949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.264093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.264185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.264214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.264349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.264506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.619 [2024-10-16 07:25:57.264534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.619 qpair failed and we were unable to recover it. 00:27:54.619 [2024-10-16 07:25:57.264656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.264768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.264793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.264888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.265188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.265484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.265785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.265956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.266104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.266417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.266717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.266930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.267076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.267409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.267670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.267838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.267973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.268234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.268509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.268830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.268966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.269081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.269343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.269570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.269878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.269994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.270129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.270414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.270658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.270813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.270958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.271220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.271504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.271695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.271839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.271975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.272104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.620 [2024-10-16 07:25:57.272132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.620 qpair failed and we were unable to recover it. 00:27:54.620 [2024-10-16 07:25:57.272276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.272564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.272859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.272990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.273094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.273346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.273594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.273813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.273982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.274124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.274414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.274649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.274781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.274919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.275181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.275470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.275721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.275888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.275983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.276288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.276494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.276804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.276928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.277085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.277367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.277593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.277869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.277982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.278173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.278403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.278681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.278800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.278910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.279160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.279477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.279802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.279955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.280116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.280219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.280247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.621 qpair failed and we were unable to recover it. 00:27:54.621 [2024-10-16 07:25:57.280380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.621 [2024-10-16 07:25:57.280488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.280514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.280624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.280759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.280788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.280876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.280971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.280999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.281116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.281339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.281618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.281889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.281990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.282104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.282657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.282848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.282976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.283268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.283594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.283747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.283874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.284136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.284457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.284770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.284889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.284995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.285296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.285572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.285876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.285997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.286160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.286410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.286757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.286948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.287100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.287362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.287609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.287876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.287990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.288114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.288406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.288692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.622 [2024-10-16 07:25:57.288816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.622 qpair failed and we were unable to recover it. 00:27:54.622 [2024-10-16 07:25:57.288959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.289248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.289575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.289900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.289995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.290130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.290422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.290713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.290890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.291002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.291313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.291529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.291742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.291860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.292007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.292265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.292578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.292857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.292978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.293148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.293453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.293758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.293910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.294058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.294327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.294586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.294850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.294955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.295057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.295276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.295572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.295841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.295982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.296146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.296392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.296708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.296883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.297010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.297127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.297153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.623 qpair failed and we were unable to recover it. 00:27:54.623 [2024-10-16 07:25:57.297287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.297455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.623 [2024-10-16 07:25:57.297479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.297623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.297770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.297813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.297922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.298202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.298461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.298862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.298951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.299191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.299528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.299829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.299947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.300116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.300407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.300688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.300860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.300949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.301224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.301455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.301767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.301924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.302068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.302314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.302622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.302765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.302875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.303162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.303450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.303747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.303892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.304025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.304338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.304565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.304822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.304977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.305004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.624 qpair failed and we were unable to recover it. 00:27:54.624 [2024-10-16 07:25:57.305134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.305244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.624 [2024-10-16 07:25:57.305272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.305415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.305509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.305533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.305676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.305782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.305810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.305952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.306170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.306456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.306715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.306910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.307056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.307282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.307540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.307840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.307999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.308130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.308386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.308702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.308916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.309054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.309356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.309605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.309875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.309988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.310131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.310398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.310641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.310799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.310945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.311196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.311440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.311705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.311840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.311959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.312499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.312777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.312948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.313072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.313161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.313185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.313327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.313445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.625 [2024-10-16 07:25:57.313470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.625 qpair failed and we were unable to recover it. 00:27:54.625 [2024-10-16 07:25:57.313597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.313720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.313768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.313887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.313992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.314157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.314435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.314723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.314935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.315069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.315316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.315581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.315705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.315929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.316181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.316452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.316708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.316862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.316971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.317241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.317537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.317763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.317908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.317994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.318212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.318503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.318777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.318899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.319018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.319261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.319592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.319828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.319936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.320035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.320312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.320562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.320789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.320895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.321023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.321285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.626 [2024-10-16 07:25:57.321552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.626 [2024-10-16 07:25:57.321725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.626 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.321839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.321961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.322180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.322479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.322687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.322819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.322910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.323131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.323395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.323643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.323882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.323977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.324099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.324358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.324596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.324737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.324890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.325161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.325452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.325711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.325858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.325993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.326239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.326474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.326734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.326858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.326961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.327190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.327418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.327682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.327838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.327953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.328199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.328416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.328643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.328763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.328861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.329007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.329032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.329198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.329328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.329353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.627 qpair failed and we were unable to recover it. 00:27:54.627 [2024-10-16 07:25:57.329506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.627 [2024-10-16 07:25:57.329641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.329669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.329861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.330225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.330460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.330749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.330864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.331313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.331587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.331749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.331859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.332151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.332415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.332724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.332877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.332997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.333218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.333538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.333844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.333966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.334119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.334406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.334684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.334838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.334944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.335300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.335580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.335842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.335972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.336451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.336741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.336895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.337049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.337349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.337639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.337813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.337912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.338009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.338034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.338232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.338357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.628 [2024-10-16 07:25:57.338396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.628 qpair failed and we were unable to recover it. 00:27:54.628 [2024-10-16 07:25:57.338530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.338622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.338651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.338790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.338915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.338939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.339070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.339341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.339664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.339879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.339992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.340189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.340466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.340722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.340924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.341057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.341324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.341576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.341856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.341984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.342121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.342403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.342683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.342826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.342941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.343257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.343526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.343736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.343855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.344189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.344488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.344783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.344906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.345002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.345263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.345582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.345754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.345893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.346028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.346055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.629 qpair failed and we were unable to recover it. 00:27:54.629 [2024-10-16 07:25:57.346218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.346314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.629 [2024-10-16 07:25:57.346342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.346485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.346604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.346628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.346768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.346888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.346926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.347024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.347275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.347608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.347743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.347888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.348176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.348489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.348772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.348926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.349080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.349373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.349696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.349855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.349997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.350260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.350497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.350798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.350948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.351076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.351409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.351705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.351861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.352054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.352404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.352740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.352875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.352990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.353271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.353559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.353700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.353861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.354155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.354490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.354824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.354950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.355073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.355189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.355213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.630 qpair failed and we were unable to recover it. 00:27:54.630 [2024-10-16 07:25:57.355335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.630 [2024-10-16 07:25:57.355458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.355482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.355631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.355724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.355766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.355926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.356273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.356535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.356815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.356945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.357036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.357270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.357566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.357766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.357889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.358139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.358444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.358698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.358825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.358944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.359202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.359508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.359793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.359927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.360021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.360351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.360604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.360720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.360896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.361196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.361473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.361768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.361883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.362028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.362322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.362641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.362827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.362938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.363139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.363435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.631 qpair failed and we were unable to recover it. 00:27:54.631 [2024-10-16 07:25:57.363747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.631 [2024-10-16 07:25:57.363838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.363862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.364024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.364318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.364586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.364830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.364975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.365073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.365401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.365656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.365808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.365969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.366295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.366542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.366771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.366907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.367020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.367282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.367547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.367847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.367970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.368059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.368360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.368679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.368835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.368928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.369165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.369446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.369697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.369853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.369947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.370287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.370509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.370740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.370906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.371075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.371375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.371640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.371827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.371975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.372097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.632 [2024-10-16 07:25:57.372123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.632 qpair failed and we were unable to recover it. 00:27:54.632 [2024-10-16 07:25:57.372260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.372541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.372823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.372936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.373080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.373348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.373639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.373898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.373997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.374166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.374442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.374686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.374863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.374993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.375328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.375684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.375860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.376000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.376300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.376568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.376834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.376956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.377080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.377332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.377598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.377769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.377910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.378474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.378767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.378964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.379076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.379345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.379643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.379786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.633 [2024-10-16 07:25:57.379913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.380017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.633 [2024-10-16 07:25:57.380045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.633 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.380168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.380439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.380756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.380911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.381017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.381291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.381532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.381851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.381998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.382112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.382378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.382695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.382856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.382975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.383283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.383573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.383879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.383992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.384104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.384444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.384679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.384826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.384989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.385231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.385472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.385691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.385848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.385993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.386280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.386537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.386808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.386988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.387152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.387426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.387715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.387895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.388032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.388180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.388205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.388318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.388445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.388472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.634 qpair failed and we were unable to recover it. 00:27:54.634 [2024-10-16 07:25:57.388562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.634 [2024-10-16 07:25:57.388692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.388719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.388873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.388992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.389139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.389453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.389746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.389870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.389955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.390205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.390508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.390816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.390979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.391153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.391385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.391638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.391874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.391999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.392195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.392474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.392757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.392941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.393063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.393359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.393622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.393803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.393918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.394167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.394487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.394772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.394912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.395009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.395311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.395600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.395781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.395936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.396207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.396536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.396800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.396984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.397089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.397196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.635 [2024-10-16 07:25:57.397225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.635 qpair failed and we were unable to recover it. 00:27:54.635 [2024-10-16 07:25:57.397362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.397484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.397508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.397619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.397724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.397762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.397868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.398194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.398467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.398787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.398917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.399097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.399410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.399640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.399828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.399936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.400185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.400430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.400691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.400841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.400972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.401282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.401554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.401783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.401961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.402120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.402460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.402718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.402892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.403023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.403316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.403594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.403764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.403921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.404168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.404416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.404662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.404798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.404950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.405288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.405583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.405744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.636 [2024-10-16 07:25:57.405880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.406006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.636 [2024-10-16 07:25:57.406031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.636 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.406119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.406343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.406635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.406828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.406927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.407177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.407470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.407782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.407928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.408064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.408406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.408758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.408911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.409066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.409356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.409621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.409776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.409895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.410224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.410541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.410830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.410962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.411145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.411403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.411658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.411813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.411958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.412208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.412487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.412774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.412893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.413043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.413345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.413638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.413764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.637 qpair failed and we were unable to recover it. 00:27:54.637 [2024-10-16 07:25:57.413905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.414028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.637 [2024-10-16 07:25:57.414056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.414184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.414500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.414759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.414883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.415046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.415373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.415670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.415814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.415943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.416267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.416508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.416703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.416853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.417119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.417391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.417639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.417769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.417914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.418156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.418480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.418791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.418935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.419078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.419406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.419674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.419824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.419964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.420224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.420559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.420850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.420978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.421136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.421464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.421669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.421841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.421943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.422201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.422517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.638 qpair failed and we were unable to recover it. 00:27:54.638 [2024-10-16 07:25:57.422834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.638 [2024-10-16 07:25:57.422972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.423154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.423420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.423698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.423910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.424035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.424330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.424567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.424722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.424897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.425153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.425392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.425688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.425817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.425958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.426209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.426473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.426741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.426905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.427072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.427400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.427690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.427868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.427964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.428293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.428608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.428781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.428937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.429255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.429500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.429766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.429952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.430124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.430380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.430661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.430843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.430957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.431221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.431454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.639 [2024-10-16 07:25:57.431629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.639 qpair failed and we were unable to recover it. 00:27:54.639 [2024-10-16 07:25:57.431807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.431903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.431929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.432071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.432295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.432519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.432755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.432901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.433083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.433349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.433630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.433803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.433953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.434226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.434486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.434794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.434920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.435060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.435312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.435547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.435719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.435876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.436148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.436471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.436774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.436915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.437040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.437323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.437625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.437779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.437952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.438264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.438500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.438706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.438934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.439070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.439717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.439887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.440054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.440157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.440185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.640 [2024-10-16 07:25:57.440329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.440427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.640 [2024-10-16 07:25:57.440451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.640 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.440561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.440683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.440711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.440861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.440991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.441186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.441498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.441787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.441918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.442071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.442351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.442596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.442770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.442883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.443177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.443469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.443714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.443870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.444009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.444277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.444602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.444899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.444998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.445134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.445426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.445658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.445841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.445944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.446242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.446534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.446808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.446955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.447072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.447303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.447584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.447765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.447884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.448230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.448511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.448801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.448912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.641 qpair failed and we were unable to recover it. 00:27:54.641 [2024-10-16 07:25:57.449005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.641 [2024-10-16 07:25:57.449119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.449280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.449553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.449789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.449955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.450090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.450412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.450703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.450870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.450972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.451295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.451618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.451864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.451997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.452186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.452393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.452631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.452799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.452908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.453190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.453456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.453725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.453878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.454025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.454291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.454570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.454865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.454990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.455145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.455443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.455643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.455792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.455905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.456011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.456038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.642 [2024-10-16 07:25:57.456165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.456247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.642 [2024-10-16 07:25:57.456273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.642 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.456368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.456485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.456514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.456625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.456721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.456756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.456883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.457124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.457456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.457787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.457928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.458090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.458334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.458586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.458848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.458982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.459165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.459422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.459668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.459834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.460014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.460221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.460484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.460769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.460889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.461022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.461259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.461493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.461823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.461952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.462077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.462373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.462709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.462873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.463016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.463299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.463529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.463849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.463976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.464146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.464415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.643 qpair failed and we were unable to recover it. 00:27:54.643 [2024-10-16 07:25:57.464685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.643 [2024-10-16 07:25:57.464798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.464826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.464989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.465241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.465524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.465827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.465968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.466087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.466351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.466592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.466879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.466996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.467113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.467339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.467689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.467893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.468049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.468332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.468627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.468857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.468989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.469250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.469523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.469751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.469899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.470002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.470294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.470588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.470715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.470865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.471160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.471437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.471701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.471848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.471995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.472314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.472588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.472756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.472919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.473010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.473035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.473175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.473300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.644 [2024-10-16 07:25:57.473328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.644 qpair failed and we were unable to recover it. 00:27:54.644 [2024-10-16 07:25:57.473455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.473562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.473589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.473782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.473917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.473943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.474035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.474274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.474559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.474733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.474888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.475175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.475475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.475777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.475946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.476120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.476392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.476741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.476907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.477048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.477354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.477605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.477803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.477906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.478220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.478507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.478779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.478904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.479056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.479362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.479647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.479783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.479891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.480120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.480421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.480732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.480888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.480984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.481312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.481603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.481877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.481985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.482013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.645 [2024-10-16 07:25:57.482116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.482251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.645 [2024-10-16 07:25:57.482275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.645 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.482368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.482463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.482488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.482626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.482756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.482784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.482943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.483216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.483498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.483760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.483919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.484047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.484258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.484572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.484866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.484986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.485151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.485440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.485700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.485817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.485952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.486224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.486507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.486718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.486871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.487002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.487298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.487604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.487787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.487888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.488174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.488447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.488782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.488950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.489072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.489162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.489186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.489324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.489424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.646 [2024-10-16 07:25:57.489451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.646 qpair failed and we were unable to recover it. 00:27:54.646 [2024-10-16 07:25:57.489549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.489671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.489698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.489828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.489942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.489967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.490060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.490316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.490629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.490774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.490923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.491194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.491476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.491736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.491894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.491987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.492286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.492541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.492827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.492975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.493117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.493375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.493618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.493808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.493946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.494279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.494565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.494817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.494967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.495103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.495675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.495824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.495962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.496223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.496544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.496863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.496970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.497119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.497395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.497706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.497858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.647 [2024-10-16 07:25:57.498020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.498146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.647 [2024-10-16 07:25:57.498174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.647 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.498283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.498403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.498430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.498561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.498686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.498714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.498864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.498989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.499184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.499377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.499694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.499842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.499944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.500194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.500478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.500765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.500886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.501040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.501251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.501563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.501703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.501859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.502172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.502449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.502707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.502903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.503023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.503382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.503664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.503831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.503991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.504271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.504506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.504812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.504937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.505078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.505323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.505624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.505793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.505931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.506179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.506411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.506668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.506801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.506925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.507010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.507036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.648 qpair failed and we were unable to recover it. 00:27:54.648 [2024-10-16 07:25:57.507150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.648 [2024-10-16 07:25:57.507309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.507336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.507500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.507621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.507646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.507760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.507889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.507916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.508057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.508198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.508225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.508545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.508768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.508819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.508957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.509240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.509503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.509815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.509938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.510063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.510355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.510669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.510795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.510899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.511173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.511485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.511705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.511845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.511994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.512281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.512546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.512795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.512915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.513058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.513317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.513604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.513755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.513906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.514161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.514429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.514709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.514882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.515042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.515344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.515657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.515783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.515914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.516192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.516414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.649 qpair failed and we were unable to recover it. 00:27:54.649 [2024-10-16 07:25:57.516656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.649 [2024-10-16 07:25:57.516811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.516839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.516959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.517214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.517549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.517768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.517909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.518163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.518393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.518681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.518838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.518928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.519168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.519445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.519705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.519851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.519974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.520217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.520456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.520740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.520903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.521019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.521264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.521563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.521885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.521973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.522147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.522366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.522679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.522829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.522924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.523179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.523447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.523718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.523888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.523977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.524281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.524509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.524823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.524967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.650 [2024-10-16 07:25:57.525093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.525203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.650 [2024-10-16 07:25:57.525227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.650 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.525376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.525497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.525524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.525652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.525816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.525841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.525937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.526209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.526429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.526637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.526856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.526978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.527061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.527349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.527656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.527895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.527984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.528135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.528355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.528589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.528834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.528981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.529136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.529399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.529610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.651 qpair failed and we were unable to recover it. 00:27:54.651 [2024-10-16 07:25:57.529866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.651 [2024-10-16 07:25:57.529955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.529979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.530094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.530345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.530534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.530769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.530897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.531018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.531221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.531511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.531801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.531926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.532028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.532227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.532530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.532737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.532847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.532937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.533188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.533412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.533681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.533837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.533924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.534206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.534514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.534773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.534882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.534971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.535061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.535104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.535201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.535372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.939 [2024-10-16 07:25:57.535397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.939 qpair failed and we were unable to recover it. 00:27:54.939 [2024-10-16 07:25:57.535482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.535628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.535750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.535923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.535948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.536070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.536341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.536580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.536771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.536909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.537206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.537479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.537741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.537897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.538072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.538395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.538674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.538829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.538940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.539200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.539462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.539739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.539859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.539976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.540247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.540530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.540776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.540920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.541020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.541313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.541608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.541772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.541905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.542185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.542418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.542746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.542935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.543049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.543140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.543165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.940 qpair failed and we were unable to recover it. 00:27:54.940 [2024-10-16 07:25:57.543317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.940 [2024-10-16 07:25:57.543413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.543442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.543552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.543683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.543711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.543882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.544186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.544472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.544713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.544841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.544977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.545291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.545567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.545831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.545963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.546089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.546389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.546608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.546857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.546985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.547099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.547349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.547594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.547886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.547976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.548126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.548406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.548752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.548936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.549051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.549302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.549588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.549882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.549975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.550014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.550117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.550216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.550244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.941 [2024-10-16 07:25:57.550356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.550466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.941 [2024-10-16 07:25:57.550491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.941 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.550623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.550732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.550759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.550866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.550984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.551123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.551386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.551687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.551840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.552001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.552267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.552559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.552873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.552993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.553078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.553398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.553636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.553806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.553922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.554151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.554422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.554707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.554838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.554950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.555236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.555515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.555817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.555936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.556086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.556347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.556626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.556908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.556997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.557121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.557443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.557699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.557875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.557984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.558120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.942 [2024-10-16 07:25:57.558148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.942 qpair failed and we were unable to recover it. 00:27:54.942 [2024-10-16 07:25:57.558279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.558566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.558784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.558962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.559061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.559414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.559707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.559886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.560024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.560316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.560603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.560795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.560904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.561235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.561506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.561766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.561955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.562092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.562377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.562662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.562846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.562958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.563299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.563519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.563828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.563996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.564136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.564399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.564742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.943 [2024-10-16 07:25:57.564878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.943 qpair failed and we were unable to recover it. 00:27:54.943 [2024-10-16 07:25:57.565013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.565285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.565615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.565783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.565928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.566192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.566501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.566760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.566902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.567006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.567245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.567575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.567875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.567981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.568147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.568400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.568644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.568771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.568921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.569138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.569388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.569719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.569919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.570063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.570341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.570593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.570806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.570931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.571189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.571443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.944 qpair failed and we were unable to recover it. 00:27:54.944 [2024-10-16 07:25:57.571689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.944 [2024-10-16 07:25:57.571817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.571843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.571966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.572306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.572548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.572819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.572943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.573064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.573400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.573674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.573930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.574069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.574378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.574697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.574858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.575021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.575340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.575608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.575785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.575927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.576207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.576439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.576745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.576913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.577055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.577299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.577573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.577715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.577887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.578181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.578479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.578815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.578951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.579074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.579163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.579190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.945 qpair failed and we were unable to recover it. 00:27:54.945 [2024-10-16 07:25:57.579346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.945 [2024-10-16 07:25:57.579486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.579510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.579693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.579844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.579870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.579985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.580281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.580501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.580819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.580970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.581064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.581330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.581610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.581794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.581911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.582162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.582447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.582742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.582854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.582936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.583232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.583539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.583814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.583954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.584088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.584321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.584560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.584816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.584927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.585037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.585316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.585632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.585813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.585955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.586143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.586447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.946 qpair failed and we were unable to recover it. 00:27:54.946 [2024-10-16 07:25:57.586748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.946 [2024-10-16 07:25:57.586839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.586863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.586974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.587268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.587537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.587783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.587948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.588057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.588407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.588712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.588860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.588997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.589280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.589544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.589841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.589986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.590098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.590298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.590607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.590798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.590934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.591145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.591380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.591677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.591793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.591939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.592209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.592543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.592806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.592967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.593091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.593362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.593597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.593865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.593989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.594013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.947 qpair failed and we were unable to recover it. 00:27:54.947 [2024-10-16 07:25:57.594133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.947 [2024-10-16 07:25:57.594225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.594250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.594376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.594528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.594555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.594656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.594787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.594815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.594927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.595192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.595413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.595739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.595885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.595986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.596238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.596540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.596723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.596916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.597047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.597356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.597567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.597842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.597984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.598149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.598465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.598747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.598908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.599089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.599361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.599644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.599795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.599938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.600172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.600497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.600797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.600916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.948 [2024-10-16 07:25:57.601053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.601155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.948 [2024-10-16 07:25:57.601182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.948 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.601315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.601448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.601475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.601596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.601714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.601747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.601886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.602150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.602451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.602714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.602855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.602988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.603259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.603490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.603742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.603913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.604059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.604293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.604574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.604836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.604996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.605110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.605363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.605690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.605871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.606022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.606336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.606622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.606856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.606991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.607153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.607410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.607641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.607808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.607931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.608221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.608504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.949 qpair failed and we were unable to recover it. 00:27:54.949 [2024-10-16 07:25:57.608802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.949 [2024-10-16 07:25:57.608932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.608959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.609102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.609358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.609680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.609873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.610009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.610262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.610550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.610867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.610993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.611159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.611421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.611684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.611851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.612013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.612269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.612558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.612851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.612977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.613102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.613408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.613705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.613884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.614027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.614313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.614603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.614886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.614994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.615174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.615392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.950 qpair failed and we were unable to recover it. 00:27:54.950 [2024-10-16 07:25:57.615635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.950 [2024-10-16 07:25:57.615768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.615796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.615945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.616185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.616509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.616780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.616896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.617020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.617296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.617536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.617782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.617921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.618058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.618354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.618616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.618849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.618973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.619170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.619470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.619764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.619925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.620093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.620396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.620667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.620826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.620959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.621268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.621582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.621883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.621980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.622125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.622383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.951 qpair failed and we were unable to recover it. 00:27:54.951 [2024-10-16 07:25:57.622654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.951 [2024-10-16 07:25:57.622777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.622806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.622917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.623147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.623446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.623739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.623929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.624024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.624333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.624570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.624761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.624900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.625246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.625547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.625793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.625900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.626044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.626327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.626579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.626886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.626982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.627123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.627416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.627710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.627856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.627986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.628232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.628519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.628774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.628924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.629098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.629329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.629577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.629846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.629969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.630079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.630222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.630248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.952 qpair failed and we were unable to recover it. 00:27:54.952 [2024-10-16 07:25:57.630416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.630536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.952 [2024-10-16 07:25:57.630561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.630655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.630790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.630816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.630936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.631216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.631477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.631755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.631927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.632042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.632254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.632479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.632813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.632984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.633091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.633355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.633677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.633834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.633978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.634278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.634556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.634831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.634957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.635114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.635433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.635717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.635857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.635983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.636078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.636105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.636217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.636346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.636371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.953 qpair failed and we were unable to recover it. 00:27:54.953 [2024-10-16 07:25:57.636479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.953 [2024-10-16 07:25:57.636635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.636663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.636759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.636877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.636902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.637032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.637291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.637543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.637849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.637986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.638103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.638419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.638671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.638799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.638945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.639189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.639520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.639820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.639949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.640074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.640309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.640599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.640762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.640924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.641162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.641379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.641650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.641831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.641976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.642271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.642526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.642893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.642990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.643189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.643452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.643741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.643871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.954 qpair failed and we were unable to recover it. 00:27:54.954 [2024-10-16 07:25:57.644005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.954 [2024-10-16 07:25:57.644123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.644147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.644257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.644410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.644436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.644562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.644692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.644719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.644891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.645189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.645454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.645737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.645893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.645994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.646259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.646567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.646828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.646966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.647106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.647399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.647615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.647772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.647909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.648168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.648467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.648714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.648876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.649009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.649296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.649619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.649735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.649905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.650147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.650445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.650724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.650878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.651026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.651273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.651550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.955 qpair failed and we were unable to recover it. 00:27:54.955 [2024-10-16 07:25:57.651864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.955 [2024-10-16 07:25:57.651978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.652106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.652361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.652635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.652773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.652926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.653189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.653491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.653756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.653882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.654021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.654302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.654586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.654770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.654902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.655222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.655519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.655812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.655930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.656049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.656387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.656700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.656870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.657027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.657312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.657562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.657840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.657997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.658124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.658430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.658738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.658858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.956 qpair failed and we were unable to recover it. 00:27:54.956 [2024-10-16 07:25:57.658945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.956 [2024-10-16 07:25:57.659066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.659195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.659482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.659823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.659945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.660108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.660348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.660578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.660744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.660891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.661169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.661413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.661675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.661858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.661979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.662280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.662568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.662788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.662905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.663043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.663306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.663621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.663752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.663881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.664194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.664476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.664704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.664883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.664980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.665251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.665471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.665758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.665887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.666021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.666289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.666567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.957 [2024-10-16 07:25:57.666700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.957 qpair failed and we were unable to recover it. 00:27:54.957 [2024-10-16 07:25:57.666850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.666969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.666994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.667186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.667416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.667742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.667878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.668001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.668248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.668570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.668864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.668983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.669110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.669377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.669676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.669879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.669995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.670293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.670569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.670852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.670986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.671103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.671368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.671655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.671837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.671933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.672206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.958 qpair failed and we were unable to recover it. 00:27:54.958 [2024-10-16 07:25:57.672505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.958 [2024-10-16 07:25:57.672688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.672795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.672925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.672952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.673101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.673347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.673607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.673783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.673926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.674221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.674506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.674837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.674947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.675063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.675393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.675684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.675844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.675976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.676266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.676529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.676773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.676933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.677039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.677333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.677651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.677828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.677976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.678291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.678582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.678844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.678964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.679067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.679654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.679836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.680008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.680277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.680566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.680860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.680991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.959 qpair failed and we were unable to recover it. 00:27:54.959 [2024-10-16 07:25:57.681138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.959 [2024-10-16 07:25:57.681263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.681288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.681439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.681538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.681568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.681701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.681865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.681894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.682079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.682364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.682615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.682853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.682981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.683141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.683457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.683711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.683905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.684035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.684327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.684588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.684863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.684990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.685111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.685399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.685678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.685893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.685993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.686141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.686393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.686685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.686810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.686925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.687206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.687499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.687828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.687948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.688068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.688286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.688540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.688810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.960 [2024-10-16 07:25:57.688955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.960 qpair failed and we were unable to recover it. 00:27:54.960 [2024-10-16 07:25:57.689033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.689295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.689607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.689744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.689894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.690151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.690434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.690685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.690852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.690972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.691188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.691479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.691763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.691923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.692037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.692342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.692625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.692788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.692839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf35600 (9): Bad file descriptor 00:27:54.961 [2024-10-16 07:25:57.693092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.693389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.693719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.693841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.693963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.694230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.694461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.694733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.694850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.694968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.695208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.695471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.695688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.695812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.695930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.696196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.696439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.961 [2024-10-16 07:25:57.696596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.961 qpair failed and we were unable to recover it. 00:27:54.961 [2024-10-16 07:25:57.696697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.696864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.696890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.696973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.697244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.697593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.697839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.697952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.698091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.698326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.698658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.698904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.698993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.699168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.699452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.699696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.699882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.700019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.700276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.700551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.700833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.700954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.701105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.701396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.701647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.701846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.701947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.702233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.702572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.702905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.702991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.703125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.703357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.962 [2024-10-16 07:25:57.703602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.962 [2024-10-16 07:25:57.703778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.962 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.703901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.703995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.704125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.704387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.704641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.704797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.704918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.705225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.705509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.705795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.705965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.706083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.706351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.706607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.706844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.706962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.707049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.707329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.707661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.707767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.707902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.708196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.708426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.708725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.708860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.708989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.709154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.709179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.963 [2024-10-16 07:25:57.709328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.709449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.963 [2024-10-16 07:25:57.709474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.963 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.709621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.709758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.709787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.709891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.710162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.710425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.710660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.710818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.710950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.711208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.711486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.711779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.711897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.712034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.712298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.712601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.712767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.712917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.713206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.713496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.713779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.713907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.714077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.714275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.714553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.714831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.714979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.715096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.715354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.715651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.715776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.715920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.716163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.716441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.716773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.716923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.717093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.717265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.717303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.964 qpair failed and we were unable to recover it. 00:27:54.964 [2024-10-16 07:25:57.717445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.964 [2024-10-16 07:25:57.717579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.717607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.717716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.717855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.717881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.718027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.718618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.718834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.718951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.719094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.719363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.719653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.719816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.719942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.720283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.720568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.720743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.720906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.721210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.721510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.721814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.721944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.722040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.722349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.722626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.722763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.722880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.723121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.723363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.723683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.723851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.723995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.724287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.724557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.724823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.724971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.725100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.725377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.965 [2024-10-16 07:25:57.725604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.965 [2024-10-16 07:25:57.725775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.965 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.725899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.726204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.726496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.726766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.726950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.727080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.727339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.727648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.727790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.727934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.728148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.728383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.728717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.728842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.728985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.729245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.729541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.729790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.729924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.730004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.730244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.730500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.730717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.730917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.731072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.731306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.731636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.731791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.731966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.732046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.732071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.732194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.732293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.732321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.966 qpair failed and we were unable to recover it. 00:27:54.966 [2024-10-16 07:25:57.732423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.966 [2024-10-16 07:25:57.732519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.732547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.732691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.732796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.732822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.732926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.733173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.733466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.733678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.733802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.733922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.734164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.734405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.734715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.734911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.735052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.735363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.735643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.735804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.735924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.736173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.736511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.736778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.736893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.736986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.737197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.737485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.737735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.737857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.738018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.738252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.738474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.738768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.738925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.739100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.739325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.739615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.739801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.739924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.740071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.740097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.967 [2024-10-16 07:25:57.740269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.740402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.967 [2024-10-16 07:25:57.740429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.967 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.740588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.740757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.740783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.740931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.741209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.741496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.741755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.741900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.742048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.742373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.742639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.742787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.742913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.743213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.743474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.743703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.743891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.744018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.744279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.744557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.744779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.744912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.745191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.745506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.745762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.745902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.746003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.746094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.746119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.968 qpair failed and we were unable to recover it. 00:27:54.968 [2024-10-16 07:25:57.746244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.968 [2024-10-16 07:25:57.746401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.746429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.746554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.746711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.746748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.746888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.747166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.747410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.747661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.747801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.747930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.748241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.748523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.748800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.748927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.749036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.749368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.749626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.749791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.749924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.750222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.750438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.750649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.750843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.750964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.751268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.751554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.751817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.751927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.752023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.752297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.752555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.752801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.752914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.969 qpair failed and we were unable to recover it. 00:27:54.969 [2024-10-16 07:25:57.753005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.753171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.969 [2024-10-16 07:25:57.753199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.753310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.753550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.753834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.753992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.754135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.754445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.754764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.754916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.755027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.755299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.755599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.755771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.755895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.756182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.756511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.756790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.756955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.757071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.757323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.757603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.757759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.757887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.758176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.758469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.758769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.758929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.759067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.759369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.759620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.759812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.759934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.760285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.760533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.970 [2024-10-16 07:25:57.760837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.970 [2024-10-16 07:25:57.760987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.970 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.761108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.761339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.761598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.761887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.761975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.762147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.762378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.762632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.762820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.762938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.763234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.763520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.763795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.763943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.764124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.764429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.764709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.764840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.764995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.765275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.765559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.765848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.765978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.766150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.766443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.766710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.766907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.767041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.767336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.767666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.767851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.767989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.768190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.971 [2024-10-16 07:25:57.768493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.971 [2024-10-16 07:25:57.768656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.971 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.768777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.768895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.768920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.769046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.769296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.769612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.769799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.769934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.770237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.770534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.770826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.770981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.771154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.771410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.771707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.771870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.771999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.772269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.772485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.772740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.772862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.772975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.773216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.773480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.773777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.773923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.774036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.774353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.774589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.774877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.774976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.775005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.775128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.775250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.775278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.972 [2024-10-16 07:25:57.775423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.775515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.972 [2024-10-16 07:25:57.775539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.972 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.775638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.775738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.775767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.775898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.776191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.776455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.776716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.776855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.776976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.777214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.777486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.777775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.777921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.778066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.778375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.778678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.778825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.778972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.779256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.779517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.779769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.779931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.780027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.780325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.780623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.780878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.780994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.781172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.781406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.781673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.781801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.781936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.782082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.782107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.973 qpair failed and we were unable to recover it. 00:27:54.973 [2024-10-16 07:25:57.782248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.973 [2024-10-16 07:25:57.782352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.782381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.782520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.782673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.782702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.782879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.782968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.782993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.783096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.783372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.783674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.783794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.783933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.784252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.784565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.784829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.784958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.785118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.785446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.785686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.785892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.785984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.786236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.786441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.786696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.786887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.787058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.787311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.787628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.787788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.787937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.788152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.788447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.788704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.788818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.788949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.789229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.789479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.789768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.789910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.974 qpair failed and we were unable to recover it. 00:27:54.974 [2024-10-16 07:25:57.790040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.974 [2024-10-16 07:25:57.790200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.790368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.790608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.790886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.790990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.791148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.791455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.791713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.791879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.792044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.792273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.792537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.792861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.792983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.793105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.793430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.793723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.793852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.793991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.794250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.794564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.794823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.794961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.795093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.795387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.795698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.795835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.795956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.796257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.796530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.796789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.796951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.797190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.797215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.975 qpair failed and we were unable to recover it. 00:27:54.975 [2024-10-16 07:25:57.797369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.975 [2024-10-16 07:25:57.797502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.797530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.797661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.797801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.797827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.797922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.798156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.798437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.798766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.798953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.799039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.799315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.799544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.799817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.799950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.800046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.800327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.800591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.800744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.800906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.801176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.801410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.801618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.801885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.801981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.802158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.802375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.802617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.802768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.802912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.803200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.803549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.803788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.803903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.804011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.804301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.804526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.804856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.804980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.976 qpair failed and we were unable to recover it. 00:27:54.976 [2024-10-16 07:25:57.805095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.976 [2024-10-16 07:25:57.805183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.805293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.805571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.805904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.805998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.806189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.806504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.806772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.806915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.807034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.807316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.807580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.807824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.807943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.808038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.808346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.808615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.808870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.808993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.809114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.809372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.809650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.809786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.809892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.810140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.810427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.810693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.810807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.810974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.811223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.977 qpair failed and we were unable to recover it. 00:27:54.977 [2024-10-16 07:25:57.811514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.977 [2024-10-16 07:25:57.811657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.811798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.811934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.811963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.812123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.812387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.812618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.812736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.812834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.813177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.813476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.813737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.813877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.814034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.814274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.814582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.814861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.814986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.815072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.815397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.815664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.815809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.815910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.816216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.816477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.816712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.816861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.816964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.817201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.817471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.817761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.817927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.818094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.818208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.818234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.818356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.818455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.818484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.978 qpair failed and we were unable to recover it. 00:27:54.978 [2024-10-16 07:25:57.818650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.978 [2024-10-16 07:25:57.818771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.818799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.818965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.819209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.819444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.819747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.819883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.819992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.820213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.820539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.820838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.820998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.821124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.821426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.821695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.821863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.822001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.822267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.822514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.822842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.822984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.823170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.823393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.823652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.823815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.823927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.824188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.824425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.824718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.824838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.824971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.825228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.825507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.979 qpair failed and we were unable to recover it. 00:27:54.979 [2024-10-16 07:25:57.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.979 [2024-10-16 07:25:57.825938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.826074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.826340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.826603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.826765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.826912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.827237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.827547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.827865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.827986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.828126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.828410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.828684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.828847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.828972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.829187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.829428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.829760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.829899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.830022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.830269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.830571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.830792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.830924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.831031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.831326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.831643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.831802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.831911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.832195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.832448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.832687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.832855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.980 qpair failed and we were unable to recover it. 00:27:54.980 [2024-10-16 07:25:57.832965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.980 [2024-10-16 07:25:57.833079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.833270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.833529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.833794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.833939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.834093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.834363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.834642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.834792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.834882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.835137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.835408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.835682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.835841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.835972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.836265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.836540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.836804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.836943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.837029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.837296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.837602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.837785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.837923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.838123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.838417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.838740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.838859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.838963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.839216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.839537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.839785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.839954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.840097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.840328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.840646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.840862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.840997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.841025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.981 qpair failed and we were unable to recover it. 00:27:54.981 [2024-10-16 07:25:57.841148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.981 [2024-10-16 07:25:57.841236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.841261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.841391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.841496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.841523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.841653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.841773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.841801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.841922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.842132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.842396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.842691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.842850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.842961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.843222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.843473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.843759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.843946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.844051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.844345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.844633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.844876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.844990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.845113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.845312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.845531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.845831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.845969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.846084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.846341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.846651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.846818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.982 [2024-10-16 07:25:57.846950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.847077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.982 [2024-10-16 07:25:57.847106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.982 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.847234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.847493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.847812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.847918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.848008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.848230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.848429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.848699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.848874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.848992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.849199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.849490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.849737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.849906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.850002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.850230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.850503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.850716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.850925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.851025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.851277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.851603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:54.983 [2024-10-16 07:25:57.851879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.851988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.983 [2024-10-16 07:25:57.852014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:54.983 qpair failed and we were unable to recover it. 00:27:55.264 [2024-10-16 07:25:57.852143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-10-16 07:25:57.852233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.264 [2024-10-16 07:25:57.852258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.264 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.852376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.852491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.852516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.852626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.852753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.852782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.852897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.853395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.853619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.853850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.853967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.854082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.854388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.854655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.854812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.854926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.855183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.855439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.855661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.855840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.855955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.856225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.856455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.856735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.856857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.856974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.857259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.857519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.857871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.858013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.858290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.858502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.858815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.858961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.859080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.859168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.859194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.265 qpair failed and we were unable to recover it. 00:27:55.265 [2024-10-16 07:25:57.859308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.265 [2024-10-16 07:25:57.859436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.859464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.859567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.859661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.859689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.859850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.859941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.859967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.860092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.860375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.860654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.860801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.860921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.861210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.861511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.861778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.861935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.862063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.862329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.862581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.862748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.862886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.863170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.863455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.863759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.863941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.864084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.864321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.864563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.864887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.864977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.865138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.865413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.865704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.865833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.865961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.866246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.866567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.866811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.866968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.867097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.867455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.266 qpair failed and we were unable to recover it. 00:27:55.266 [2024-10-16 07:25:57.867712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.266 [2024-10-16 07:25:57.867820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.867848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.867949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.868267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.868473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.868762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.868888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.869029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.869323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.869602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.869771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.869905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.870165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.870425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.870691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.870809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.870943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.871210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.871495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.871769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.871901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.872016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.872282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.872537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.872828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.872979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.873088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.873341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.873670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.873824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.873940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.874210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.874516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.874758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.874902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.875051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.875332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.875645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.875815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.267 qpair failed and we were unable to recover it. 00:27:55.267 [2024-10-16 07:25:57.875929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.267 [2024-10-16 07:25:57.876011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.876164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.876451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.876754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.876914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.877046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.877296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.877577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.877767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.877897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.878199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.878538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.878709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.878891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.879208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.879449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.879745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.879903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.880072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.880397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.880673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.880781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.880971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.881198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.881483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.881776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.881900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.882026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.882320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.882626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.882832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.882978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.883170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.883462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.883738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.883897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.884003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.884299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.268 [2024-10-16 07:25:57.884547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.268 [2024-10-16 07:25:57.884703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.268 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.884859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.884985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.885151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.885396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.885674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.885876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.886021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.886266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.886508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.886751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.886856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.886941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.887177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.887425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.887625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.887796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.887925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.888215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.888464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.888761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.888948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.889066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.889361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.889622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.889767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.889926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.890209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.890447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.890747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.890887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.890989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.891085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.891114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.891238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.891363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.891391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.269 qpair failed and we were unable to recover it. 00:27:55.269 [2024-10-16 07:25:57.891561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.269 [2024-10-16 07:25:57.891679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.891704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.891862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.891992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.892159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.892420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.892646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.892814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.892915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.893140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.893372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.893557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.893840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.893947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.894041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.894605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.894862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.894999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.895098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.895430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.895666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.895841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.895942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.896239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.896455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.896684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.896856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.896950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.897282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.897498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.897835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.897984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.898187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.898452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.898691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.898839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.898975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.899296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.270 qpair failed and we were unable to recover it. 00:27:55.270 [2024-10-16 07:25:57.899571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.270 [2024-10-16 07:25:57.899686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.899786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.899895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.899927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.900054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.900347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.900600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.900836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.900995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.901116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.901379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.901660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.901808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.901922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.902170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.902485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.902726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.902878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.902984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.903315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.903556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.903872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.903998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.904128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.904398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.904599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.904850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.904964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.905117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.905367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.905696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.905858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.905973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.906179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.906411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.906690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.906840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.906977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.907233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.271 [2024-10-16 07:25:57.907497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.271 [2024-10-16 07:25:57.907647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.271 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.907750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.907862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.907887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.907986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.908216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.908489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.908802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.908959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.909068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.909328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.909559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.909753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.909891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.910133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.910417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.910664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.910803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.910928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.911153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.911380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.911591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.911854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.911968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.912084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.912352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.912667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.912825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.913006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.913275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.913525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.913833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.913976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.914088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.914402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.914644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.914761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.914899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.915130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.915398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.272 [2024-10-16 07:25:57.915565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.272 qpair failed and we were unable to recover it. 00:27:55.272 [2024-10-16 07:25:57.915706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.915842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.915870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.915969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.916252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.916550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.916836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.916972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.917070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.917351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.917628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.917785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.917890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.918113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.918350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.918586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.918832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.918959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.919089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.919383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.919691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.919834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.919969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.920231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.920473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.920699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.920839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.921011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.921243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.921510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.921768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.921926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.922074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.922351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.273 qpair failed and we were unable to recover it. 00:27:55.273 [2024-10-16 07:25:57.922639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.273 [2024-10-16 07:25:57.922777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.922893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.923162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.923391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.923603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.923768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.923913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.924234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.924540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.924840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.924989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.925137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.925356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.925649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.925891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.925978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.926134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.926413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.926682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.926863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.927001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.927361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.927602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.927859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.927986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.928116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.928360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.928569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.928783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.928894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.929014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.929233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.929520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.929826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.929950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.930065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.930376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.274 [2024-10-16 07:25:57.930647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.274 [2024-10-16 07:25:57.930762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.274 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.930896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.931216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.931537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.931798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.931983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.932081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.932336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.932578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.932854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.932990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.933085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.933376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.933634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.933806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.933893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.934171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.934446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.934757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.934900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.935043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.935280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.935536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.935753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.935946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.936049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.936337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.936640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.936797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.936932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.937200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.937401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.937710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.937866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.937986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.938273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.938518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.938859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.938981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.275 [2024-10-16 07:25:57.939007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.275 qpair failed and we were unable to recover it. 00:27:55.275 [2024-10-16 07:25:57.939093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.939323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.939638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.939786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.939937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.940195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.940526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.940719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.940902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.941007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.941301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.941615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.941799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.941908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.942147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.942450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.942683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.942850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.942996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.943248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.943512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.943779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.943898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.944026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.944295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.944575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.944865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.944998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.945125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.945389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.945667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.945814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.945943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.946184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.946377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.946641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.946803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.946917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.947010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.947035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.276 qpair failed and we were unable to recover it. 00:27:55.276 [2024-10-16 07:25:57.947153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.276 [2024-10-16 07:25:57.947285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.947313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.947453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.947580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.947609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.947743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.947842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.947867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.947985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.948290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.948584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.948738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.948878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.949183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.949411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.949744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.949878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.949966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.950226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.950429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.950735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.950895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.951039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.951283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.951507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.951794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.951911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.952025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.952255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.952586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.952834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.952949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.953058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.953328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.953593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.953792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.953922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.954219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.954488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.954795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.954915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.277 qpair failed and we were unable to recover it. 00:27:55.277 [2024-10-16 07:25:57.955063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.955151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.277 [2024-10-16 07:25:57.955176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.955315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.955555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.955844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.955953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.956066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.956293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.956543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.956802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.956939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.957081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.957384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.957642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.957771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.957899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.958204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.958428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.958676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.958818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.958963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.959280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.959582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.959748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.959898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.960212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.960434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.960703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.960852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.961037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.961242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.961542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.961764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.961874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.962045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.962171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.962199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.962366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.962478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.962503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.278 qpair failed and we were unable to recover it. 00:27:55.278 [2024-10-16 07:25:57.962649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.278 [2024-10-16 07:25:57.962779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.962808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.962938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.963180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.963419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.963718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.963880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.964005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.964292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.964516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.964814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.964935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.965022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.965357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.965653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.965775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.965928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.966235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.966494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.966737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.966874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.966967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.967198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.967448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.967736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.967871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.968006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.968297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.968567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.968876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.968982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.969346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.969646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.969819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.969930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.970217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.970456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.279 [2024-10-16 07:25:57.970718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.279 [2024-10-16 07:25:57.970859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.279 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.970985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.971308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.971542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.971725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.971882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.972181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.972460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.972737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.972870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.973007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.973301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.973601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.973915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.973997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.974117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.974395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.974689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.974857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.975030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.975290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.975586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.975735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.975869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.976156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.976483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.976772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.976958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.977098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.977394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.977670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.977825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.977956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.978234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.978505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.978812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.978960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.979108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.979283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.979350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.979490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.979619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.280 [2024-10-16 07:25:57.979648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.280 qpair failed and we were unable to recover it. 00:27:55.280 [2024-10-16 07:25:57.979777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.979901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.979929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.980036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.980275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.980574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.980869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.980982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.981145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.981378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.981688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.981822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.981907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.982160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.982419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.982695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.982842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.982978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.983213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.983457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.983723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.983903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.984040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.984278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.984513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.984821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.984943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.985053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.985331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.985605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.985716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.985871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.986171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.986409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.986734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.986856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.986995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.987288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.987580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.281 qpair failed and we were unable to recover it. 00:27:55.281 [2024-10-16 07:25:57.987886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.281 [2024-10-16 07:25:57.987973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.988132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.988439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.988668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.988849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.988984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.989078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.989103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.989224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.989387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.989414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.989975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.990326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.990653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.990821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.990924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.991258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.991487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.991826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.991970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.992066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.992306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.992527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.992813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.992935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.993028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.993276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.993557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.993833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.993993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.994168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.994408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.994691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.994865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.995001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.995309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.282 qpair failed and we were unable to recover it. 00:27:55.282 [2024-10-16 07:25:57.995536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.282 [2024-10-16 07:25:57.995721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.995862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.995965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.995993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.996101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.996375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.996604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.996762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.996898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.997191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.997497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.997757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.997887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.997990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.998258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.998547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.998809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.998939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:57.999063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.999157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:57.999185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.002122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.002524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.002846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.002969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.003123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.003370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.003637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.003901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.003995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.004175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.004459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.004751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.004874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.005001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.005274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.005564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.005706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.005875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.006229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.006527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.283 [2024-10-16 07:25:58.006746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.283 [2024-10-16 07:25:58.006899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.283 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.007003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.007298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.007525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.007654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.007813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.008805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.008840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.008996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.009333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.009567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.009862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.009987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.010089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.010329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.010582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.010868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.010996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.011128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.011433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.011758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.011955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.012098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.012394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.012636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.012804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.012899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.013206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.013517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.013830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.013949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.014080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.014344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.014660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.014787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.014931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.015247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.015523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.015804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.015954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.016134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.016260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.016288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.284 qpair failed and we were unable to recover it. 00:27:55.284 [2024-10-16 07:25:58.016422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.284 [2024-10-16 07:25:58.016580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.016608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.016738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.016868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.016893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.017013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.017344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.017611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.017762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.017891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.018176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.018408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.018700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.018881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.019019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.019316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.019635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.019830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.019959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.020311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.020615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.020774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.020933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.021215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.021470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.021803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.021920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.022071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.022307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.022609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.022754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.022905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.023196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.023415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.023775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.023895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.024030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.024333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.024632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.024882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.024971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.025016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.285 qpair failed and we were unable to recover it. 00:27:55.285 [2024-10-16 07:25:58.025152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.285 [2024-10-16 07:25:58.025295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.025322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.025470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.025588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.025613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.025782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.025926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.025951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.026081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.026289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.026610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.026866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.026992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.027126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.027418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.027740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.027903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.028041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.028309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.028593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.028779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.028952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.029251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.029578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.029853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.029969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.030067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.030358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.030672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.030808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.030924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.031250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.031552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.031861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.031990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.032156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.032432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.032721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.032859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.286 qpair failed and we were unable to recover it. 00:27:55.286 [2024-10-16 07:25:58.033008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.033104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.286 [2024-10-16 07:25:58.033128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.033268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.033419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.033461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.033620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.033762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.033790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.033924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.034206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.034487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.034784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.034943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.035079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.035306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.035618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.035763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.035883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.036171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.036458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.036764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.036883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.036996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.037285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.037548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.037717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.037874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.038171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.038432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.038800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.038952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.039085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.039373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.039684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.039819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.039942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.040235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.040492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.040757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.040889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.041000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.041220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.041491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.287 [2024-10-16 07:25:58.041684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.287 qpair failed and we were unable to recover it. 00:27:55.287 [2024-10-16 07:25:58.041796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.041906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.041931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.042057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.042344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.042699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.042834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.042977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.043267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.043551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.043844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.043994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.044130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.044429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.044736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.044897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.045023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.045350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.045599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.045766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.045879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.046188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.046505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.046773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.046892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.047007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.047279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.047570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.047899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.047995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.048168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.048461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.048784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.048930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.049074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.049396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.049739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.049897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.049986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.050157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.050185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.050337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.050455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.050482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.288 qpair failed and we were unable to recover it. 00:27:55.288 [2024-10-16 07:25:58.050601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.288 [2024-10-16 07:25:58.050721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.050754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.050865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.050970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.050998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.051125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.051390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.051757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.051920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.052082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.052349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.052599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.052772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.052894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.053211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.053504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.053834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.053989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.054151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.054403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.054700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.054845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.054965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.055198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.055485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.055759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.055906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.056031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.056328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.056614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.056747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.056888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.057143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.057460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.057741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.057909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.058032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.058325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.058594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.058762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.058894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.059022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.059050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.289 qpair failed and we were unable to recover it. 00:27:55.289 [2024-10-16 07:25:58.059203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.059314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.289 [2024-10-16 07:25:58.059339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.059512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.059613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.059643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.059786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.059921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.059948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.060076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.060404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.060663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.060788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.060937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.061249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.061509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.061750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.061877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.062021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.062278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.062578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.062877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.062985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.063081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.063381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.063610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.063755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.063921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.064163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.064442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.064758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.064891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.065008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.065294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.065642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.065796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.065928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.066179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.066463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.290 qpair failed and we were unable to recover it. 00:27:55.290 [2024-10-16 07:25:58.066754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.290 [2024-10-16 07:25:58.066900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.067029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.067282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.067581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.067690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.067843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.068198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.068519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.068689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.068840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.069203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.069511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.069779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.069937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.070081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.070320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.070637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.070771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.070898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.071171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.071450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.071743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.071916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.072073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.072399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.072676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.072805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.072910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.073166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.073425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.073707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.073854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.073936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.074203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.074484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.074797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.074965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.075049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.075173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.075198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.291 [2024-10-16 07:25:58.075352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.075450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.291 [2024-10-16 07:25:58.075475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.291 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.075581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.075685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.075712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.075844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.075944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.075971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.076113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.076376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.076617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.076797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.076919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.077217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.077498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.077803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.077972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.078094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.078309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.078633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.078888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.078983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.079143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.079440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.079671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.079802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.079937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.080260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.080538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.080867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.080992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.081108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.081362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.081674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.081859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.082000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.082280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.082523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.082888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.082999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.083202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.083473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.083780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.292 [2024-10-16 07:25:58.083964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.292 qpair failed and we were unable to recover it. 00:27:55.292 [2024-10-16 07:25:58.084118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.084352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.084669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.084788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.084933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.085198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.085478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.085740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.085912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.086034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.086337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.086654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.086887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.086991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.087105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.087376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.087653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.087788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.087907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.088225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.088508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.088800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.088937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.089111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.089407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.089693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.089844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.089961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.090183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.090506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.090787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.090979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.091077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.091393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.091646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.091815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.091939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.092072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.092099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.092212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.092301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.092326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.293 qpair failed and we were unable to recover it. 00:27:55.293 [2024-10-16 07:25:58.092421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.293 [2024-10-16 07:25:58.092558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.092585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.092686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.092829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.092858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.093021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.093334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.093578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.093849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.093953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.094094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.094353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.094671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.094784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.094874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.095191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.095474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.095791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.095911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.096025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.096280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.096590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.096714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.096879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.097193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.097510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.097778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.097918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.098005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.098290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.098576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.098883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.098975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.099082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.099389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.099653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.099793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.099946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.100240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.100566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.294 [2024-10-16 07:25:58.100829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.294 [2024-10-16 07:25:58.100999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.294 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.101158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.101413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.101722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.101869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.102019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.102301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.102585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.102824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.102972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.103092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.103393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.103657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.103843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.103982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.104293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.104552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.104802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.104970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.105102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.105331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.105601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.105843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.105977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.106109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.106428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.106726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.106880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.107015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.107304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.107513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.107813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.107936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.108073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.108188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.108212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.295 qpair failed and we were unable to recover it. 00:27:55.295 [2024-10-16 07:25:58.108348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.295 [2024-10-16 07:25:58.108442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.108469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.108689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.108718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.108846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.108929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.108955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.109114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.109393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.109687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.109840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.109982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.110262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.110587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.110732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.110879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.111155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.111463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.111666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.111837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.111966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.112246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.112501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.112773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.112931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.113036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.113277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.113565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.113717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.113846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.114133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.114483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.114808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.114927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.115068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.115382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.115641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.115787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.115901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.116135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.116393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.296 qpair failed and we were unable to recover it. 00:27:55.296 [2024-10-16 07:25:58.116654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.296 [2024-10-16 07:25:58.116790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.116948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.117380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.117646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.117816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.117935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.118239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.118432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.118698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.118863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.119008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.119214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.119534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.119845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.119986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.120125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.120440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.120766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.120884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.120983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.121266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.121518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.121758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.121914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.122074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.122336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.122616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.122865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.122973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.123121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.123322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.123623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.123781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.123900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.124159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.124433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.124698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.124812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.124974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.125090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.297 [2024-10-16 07:25:58.125122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.297 qpair failed and we were unable to recover it. 00:27:55.297 [2024-10-16 07:25:58.125288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.125421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.125448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.125571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.125716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.125767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.125903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.126191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.126419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.126689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.126851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.127009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.127240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.127542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.127881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.127971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.128095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.128349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.128593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.128831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.128978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.129075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.129367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.129638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.129780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.129943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.130222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.130586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.130869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.130984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.131186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.131417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.131693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.131886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.132044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.132330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.132585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.132818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.132980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.133081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.133162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.133187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.133278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.133424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.133452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.298 qpair failed and we were unable to recover it. 00:27:55.298 [2024-10-16 07:25:58.133586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.298 [2024-10-16 07:25:58.133711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.133761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.133930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.134166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.134471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.134738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.134877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.134990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.135285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.135554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.135870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.135977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.136110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.136433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.136666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.136816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.136903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.137190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.137491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.137786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.137944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.138083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.138376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.138635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.138763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.138939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.139207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.139507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.139740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.139848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.139937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.140135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.140490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.299 qpair failed and we were unable to recover it. 00:27:55.299 [2024-10-16 07:25:58.140788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.299 [2024-10-16 07:25:58.140939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.140963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.141046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.141339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.141583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.141826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.141959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.142269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.142564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.142881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.142974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.143135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.143396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.143650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.143785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.143919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.144198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.144507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.144813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.144922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.145034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.145312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.145638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.145807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.145937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.146185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.146454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.146655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.146809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.146937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.147327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.147588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.147879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.147992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.148112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.148343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.148663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.148834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.148958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.149043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.149067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.300 qpair failed and we were unable to recover it. 00:27:55.300 [2024-10-16 07:25:58.149206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.300 [2024-10-16 07:25:58.149332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.149359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.149483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.149634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.149662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.149770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.149914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.149939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.150079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.150354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.150631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.150753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.150910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.151264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.151591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.151872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.151994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.152088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.152406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.152647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.152804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.152925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.153220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.153531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.153830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.153941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.154136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.154430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.154710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.154848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.154994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.155294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.155584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.155885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.155977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.156135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.156417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.156716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.156839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.156954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.157188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.157475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.301 [2024-10-16 07:25:58.157842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.157977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.301 [2024-10-16 07:25:58.158005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.301 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.158104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.158377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.158655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.158884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.159018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.159279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.159636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.159801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.159901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.160200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.160542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.160856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.160980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.161126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.161512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.161767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.161930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.162056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.162302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.162596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.162837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.162980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.163113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.163432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.163723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.163872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.163993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.164248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.164531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.164805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.164947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.165078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.165313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.165591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.165785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.165910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.166231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.166578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.302 [2024-10-16 07:25:58.166743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.302 qpair failed and we were unable to recover it. 00:27:55.302 [2024-10-16 07:25:58.166880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.167204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.167482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.167785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.167947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.168086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.168345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.168606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.168852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.168996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.169171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.169449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.169698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.169837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.169953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.170198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.170470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.170755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.170889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.170985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.171295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.171535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.171818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.171934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.172052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.172297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.172540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.172876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.172995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.173190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.173454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.173666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.173804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.173936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.174093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.174121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.303 qpair failed and we were unable to recover it. 00:27:55.303 [2024-10-16 07:25:58.174213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.303 [2024-10-16 07:25:58.174340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.174368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.174502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.174650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.174675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.174817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.174949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.174976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.175110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.175384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.175699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.175880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.175979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.176338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.176625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.176778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.176931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.177157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.177438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.177691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.177867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.178005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.178223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.178584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.178835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.178978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.179062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.179429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.179751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.179874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.179990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.180299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.180531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.180779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.180914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.181049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.181288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.181550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.181779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.181921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.182191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.182438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.304 qpair failed and we were unable to recover it. 00:27:55.304 [2024-10-16 07:25:58.182659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.304 [2024-10-16 07:25:58.182787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.182817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.182939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.183175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.183458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.183720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.183849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.183967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.184064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.184089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.184183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.184282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.305 [2024-10-16 07:25:58.184307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.305 qpair failed and we were unable to recover it. 00:27:55.305 [2024-10-16 07:25:58.184394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.592 [2024-10-16 07:25:58.184480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.592 [2024-10-16 07:25:58.184506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.592 qpair failed and we were unable to recover it. 00:27:55.592 [2024-10-16 07:25:58.184629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.592 [2024-10-16 07:25:58.184711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.592 [2024-10-16 07:25:58.184746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.184848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.184948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.184975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.185078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.185389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.185648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.185861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.185997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.186113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.186352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.186579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.186799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.186931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.187025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.187308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.187514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.187796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.187900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.188015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.188208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.188468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.188740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.188919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.189085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.189360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.189647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.189798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.189903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.190217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.190487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.190804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.190975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.191116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.191405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.593 qpair failed and we were unable to recover it. 00:27:55.593 [2024-10-16 07:25:58.191681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.593 [2024-10-16 07:25:58.191843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.191998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.192328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.192601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.192756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.192855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.193201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.193474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.193761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.193932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.194054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.194392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.194676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.194800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.194949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.195204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.195486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.195818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.195993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.196137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.196476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.196703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.196819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.196937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.197244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.197549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.197715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.197873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.198161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.198427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.198710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.198879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.199049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.199319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.199602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.199761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.199919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.200207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.594 [2024-10-16 07:25:58.200492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.594 [2024-10-16 07:25:58.200620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.594 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.200713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.200882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.200909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.201079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.201409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.201710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.201868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.201983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.202212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.202511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.202741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.202884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.203025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.203337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.203624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.203793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.203905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.204227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.204527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.204806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.204930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.205058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.205346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.205599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.205859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.205985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.206170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.206382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.206660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.206813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.206955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.207191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.207448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.207663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.207889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.207996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.208164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.208518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.595 qpair failed and we were unable to recover it. 00:27:55.595 [2024-10-16 07:25:58.208766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.595 [2024-10-16 07:25:58.208883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.208975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.209236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.209524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.209793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.209955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.210061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.210324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.210559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.210841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.210994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.211165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.211475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.211759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.211903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.211999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.212296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.212562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.212862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.212980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.213156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.213486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.213741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.213874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.214011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.214330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.214603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.214769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.214897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.215187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.215460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.215756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.215920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.216029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.216311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.216623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.216796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.216912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.217030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.217055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.596 [2024-10-16 07:25:58.217165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.217286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.596 [2024-10-16 07:25:58.217314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.596 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.217411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.217566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.217593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.217725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.217848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.217873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.217993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.218286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.218567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.218852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.218978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.219110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.219374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.219614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.219852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.219988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.220139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.220373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.220691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.220883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.221050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.221335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.221553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.221885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.221978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.222140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.222459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.222725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.222839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.222949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.223256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.223583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.223722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.223912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.224066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.224093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.597 qpair failed and we were unable to recover it. 00:27:55.597 [2024-10-16 07:25:58.224252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.224408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.597 [2024-10-16 07:25:58.224434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.224570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.224685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.224711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.224857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.225149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.225387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.225609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.225793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.225919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.226215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.226501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.226760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.226914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.227091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.227362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.227614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.227768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.227929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.228212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.228470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.228811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.228934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.229318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.229611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.229895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.229982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.230151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.230412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.230735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.230890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.231029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.231336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.231559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.231856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.231976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.232166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.232367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.232637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.598 [2024-10-16 07:25:58.232809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.598 qpair failed and we were unable to recover it. 00:27:55.598 [2024-10-16 07:25:58.232895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.233147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.233461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.233672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.233782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.233943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.234221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.234509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.234748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.234910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.235056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.235291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.235570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.235761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.235901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.236192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.236556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.236798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.236930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.237067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.237371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.237636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.237901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.237995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.238143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2024522 Killed "${NVMF_APP[@]}" "$@" 00:27:55.599 [2024-10-16 07:25:58.238459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.238787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 07:25:58 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:55.599 [2024-10-16 07:25:58.238904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.238929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 07:25:58 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:55.599 [2024-10-16 07:25:58.239035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 07:25:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:55.599 [2024-10-16 07:25:58.239164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.239191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 07:25:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:55.599 [2024-10-16 07:25:58.239316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 07:25:58 -- common/autotest_common.sh@10 -- # set +x 00:27:55.599 [2024-10-16 07:25:58.239477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.239505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.239638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.239735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.239761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.239895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.239989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.240189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.240472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.240716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.599 [2024-10-16 07:25:58.240856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.599 qpair failed and we were unable to recover it. 00:27:55.599 [2024-10-16 07:25:58.240966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.241231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.241570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.241853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.241997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.242042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.242162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.242256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.242281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.242375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.242466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.242491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.242588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- nvmf/common.sh@469 -- # nvmfpid=2025220 00:27:55.600 07:25:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:55.600 [2024-10-16 07:25:58.242742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- nvmf/common.sh@470 -- # waitforlisten 2025220 00:27:55.600 [2024-10-16 07:25:58.242776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.242909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- common/autotest_common.sh@819 -- # '[' -z 2025220 ']' 00:27:55.600 [2024-10-16 07:25:58.243022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.243047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 07:25:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:55.600 [2024-10-16 07:25:58.243182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:55.600 [2024-10-16 07:25:58.243307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:55.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:55.600 [2024-10-16 07:25:58.243334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 07:25:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:55.600 [2024-10-16 07:25:58.243443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 07:25:58 -- common/autotest_common.sh@10 -- # set +x 00:27:55.600 [2024-10-16 07:25:58.243600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.243628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.243768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.243882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.243907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.244051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.244313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.244619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.244873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.244983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.245173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.245426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.245697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.245866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.245985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.246244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.246552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.246852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.246962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.247083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.247341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.247566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.247833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.247953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.248044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.248127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.248152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.248258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.248373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.248397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.600 qpair failed and we were unable to recover it. 00:27:55.600 [2024-10-16 07:25:58.248484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.600 [2024-10-16 07:25:58.248571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.248596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.248714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.248841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.248866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.248950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.249218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.249444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.249688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.249846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.249944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.250177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.250376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.250584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.250767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.250885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.251113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.251435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.251637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.251870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.251976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.252101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.252339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.252642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.252865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.252967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.253084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.253340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.253571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.253778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.253896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.253981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.254246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.254506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.254771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.601 [2024-10-16 07:25:58.254912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.601 qpair failed and we were unable to recover it. 00:27:55.601 [2024-10-16 07:25:58.255061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.255340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.255573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.255841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.255965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.256057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.256292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.256515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.256762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.256885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.256976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.257270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.257499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.257756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.257902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.257989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.258226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.258449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.258682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.258834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.258924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.259155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.259406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.259630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.259772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.259924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.260188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.260476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.260743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.260856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.260937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.261223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.261456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.261659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.261902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.261982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.262008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.262151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.262271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.262296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.602 qpair failed and we were unable to recover it. 00:27:55.602 [2024-10-16 07:25:58.262415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.602 [2024-10-16 07:25:58.262530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.262559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.262649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.262737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.262763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.262882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.262991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.263167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.263402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.263670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.263883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.263998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.264102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.264406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.264644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.264870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.264989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.265080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.265345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.265602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.265881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.265999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.266114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.266377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.266607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.266858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.266978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.267066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.267305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.267574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.267799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.267905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.268051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.268274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.268521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.268818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.268927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.269046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.269341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.269595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.603 qpair failed and we were unable to recover it. 00:27:55.603 [2024-10-16 07:25:58.269834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.603 [2024-10-16 07:25:58.269946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.270064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.270327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.270575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.270831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.270945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.271101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.271335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.271573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.271818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.271965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.272092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.272343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.272602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.272835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.272947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.273031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.273260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.273486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.273785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.273903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.273991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.274242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.274450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.274685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.274838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.274989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.275216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.275504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.275769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.275888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.275972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.276177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.276431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.276665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.276807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.276924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.277017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.277042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.277186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.277272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.604 [2024-10-16 07:25:58.277296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.604 qpair failed and we were unable to recover it. 00:27:55.604 [2024-10-16 07:25:58.277386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.277596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.277833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.277981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.278101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.278335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.278570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.278818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.278934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.279023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.279284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.279569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.279850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.279991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.280108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.280351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.280611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.280855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.280997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.281143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.281391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.281647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.281793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.281920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.282150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.282377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.282578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.282804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.282944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.283062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.283299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.283536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.283741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.283890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.284034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.284269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.605 qpair failed and we were unable to recover it. 00:27:55.605 [2024-10-16 07:25:58.284494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.605 [2024-10-16 07:25:58.284662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.284761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.284852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.284877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.284921] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:55.606 [2024-10-16 07:25:58.284976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.284990] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:55.606 [2024-10-16 07:25:58.285119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.285285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.285520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.285784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.285895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.286039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.286300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.286529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.286753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.286868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.286966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.287225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.287487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.287754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.287901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.287989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.288227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.288456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.288697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.288820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.288933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.289161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.289398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.289686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.289877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.289977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.290184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.290390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.290651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.290823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.290940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.291048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.606 [2024-10-16 07:25:58.291072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.606 qpair failed and we were unable to recover it. 00:27:55.606 [2024-10-16 07:25:58.291215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.291492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.291779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.291919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.292066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.292305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.292509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.292738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.292896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.292994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.293228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.293476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.293707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.293851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.293938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.294170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.294412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.294618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.294880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.294995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.295091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.295332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.295627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.295808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.295955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.296190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.296425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.296649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.296855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.296966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.297053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.297282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.297475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.297711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.297885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.297985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.298124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.298149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.298299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.298385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.298411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.607 qpair failed and we were unable to recover it. 00:27:55.607 [2024-10-16 07:25:58.298533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.607 [2024-10-16 07:25:58.298625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.298649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.298757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.298843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.298869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.298994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.299200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.299693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.299827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.299922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.300180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.300440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.300665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.300878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.300996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.301139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.301393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.301630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.301880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.301992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.302104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.302329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.302590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.302800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.302921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.303004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.303249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.303458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.303688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.303804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.303919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.304167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.304439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.304740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.304884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.304975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.305210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.305477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.608 qpair failed and we were unable to recover it. 00:27:55.608 [2024-10-16 07:25:58.305779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.608 [2024-10-16 07:25:58.305888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.305987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.306247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.306504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.306771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.306882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.306993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.307250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.307488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.307765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.307910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.308002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.308240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.308433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.308659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.308828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.308923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.309166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.309391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.309680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.309827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.309947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.310207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.310456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.310662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.310803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.310889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.311137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.311376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.311618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.311852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.311997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.312117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.312380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.312645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.312789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.312912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.313003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.313027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.313149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.313244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.609 [2024-10-16 07:25:58.313271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.609 qpair failed and we were unable to recover it. 00:27:55.609 [2024-10-16 07:25:58.313355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.313473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.313498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.313589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.313739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.313765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.313863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.314158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.314383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.314656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.314907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.314996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.315106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.315355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.315579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.315842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.315988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.316076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.316302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.316581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.316791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.316906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.317032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.317230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.317453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.317754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.317862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.317984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.318220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.318463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.318657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.318803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.318899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.319138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.319354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.610 [2024-10-16 07:25:58.319607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.610 [2024-10-16 07:25:58.319725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.610 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.319823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.319962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.319996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.320090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.320323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.320591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.320821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.320971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.321093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.321311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.321567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.321808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.321951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.322075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.322193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.322218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.322335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.322453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.322488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.322629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.611 [2024-10-16 07:25:58.322771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.322805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.322919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.323201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.323432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.323643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.323791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.323912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.324122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.324377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.324612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.324822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.324937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.325051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.325350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.325590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.325863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.325980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.326127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.326422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.326662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.326790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.326938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.327068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.327093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.327208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.327327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.611 [2024-10-16 07:25:58.327352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.611 qpair failed and we were unable to recover it. 00:27:55.611 [2024-10-16 07:25:58.327440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.327517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.327542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.327637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.327763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.327789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.327908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.328121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.328364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.328653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.328812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.328930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.329164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.329392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.329596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.329871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.329986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.330113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.330397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.330636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.330846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.330991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.331117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.331320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.331621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.331869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.331983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.332093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.332394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.332697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.332893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.333018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.333282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.333492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.333760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.333908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.333992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.334231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.334456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.334666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.612 qpair failed and we were unable to recover it. 00:27:55.612 [2024-10-16 07:25:58.334898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.612 [2024-10-16 07:25:58.334977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.335131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.335431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.335652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.335782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.335904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.336176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.336433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.336641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.336873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.336994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.337082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.337352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.337642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.337897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.337987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.338099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.338356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.338563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.338840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.338962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.339061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.339297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.339532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.339803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.339915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.340034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.340272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.340473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.340703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.340839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.340963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.341263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.341501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.341741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.341882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.341966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.342091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.342115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.613 qpair failed and we were unable to recover it. 00:27:55.613 [2024-10-16 07:25:58.342233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.613 [2024-10-16 07:25:58.342352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.342377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.342615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.342640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.342741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.342837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.342862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.342984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.343175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.343429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.343691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.343839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.343965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.344166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.344410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.344654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.344796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.344883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.345184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.345381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.345604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.345874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.345991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.346115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.346346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.346570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.346834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.346945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.347062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.347309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.347572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.347777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.347920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.348020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.348259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.348519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.614 [2024-10-16 07:25:58.348658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.614 qpair failed and we were unable to recover it. 00:27:55.614 [2024-10-16 07:25:58.348767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.348855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.348880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.349004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.349232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.349499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.349701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.349852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.349970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.350204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.350484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.350712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.350867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.350980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.351234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.351471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.351715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.351860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.351980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.352209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.352497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.352692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.352845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.352988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.353195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.353460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.353710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.353868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.353961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.354198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.354484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.354745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.354859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.354979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.355181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.355400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.355628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.355841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.355980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.615 qpair failed and we were unable to recover it. 00:27:55.615 [2024-10-16 07:25:58.356102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.615 [2024-10-16 07:25:58.356186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.356292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.356487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:55.616 [2024-10-16 07:25:58.356604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.356722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.356871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.356985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.357233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.357457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.357694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.357814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.357924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.358158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.358390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.358678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.358810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.358938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.359161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.359448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.359649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.359887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.359978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.360086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.360306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.360533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.360804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.360923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.361046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.361250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.361506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.361724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.361900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.362039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.362321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.362589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.362873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.362989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.363141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.363239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.363265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.616 qpair failed and we were unable to recover it. 00:27:55.616 [2024-10-16 07:25:58.363372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.363456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.616 [2024-10-16 07:25:58.363480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.363631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.363790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.363815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.363964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.364213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.364448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.364897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.365047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.365277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.365484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.365693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.365818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.365941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.366214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.366476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.366705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.366880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.367001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.367259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.367489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.367749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.367864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.367949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.368204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.368401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.368665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.368826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.368919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.369180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.369419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.369650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.369874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.369984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.370081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.370367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.370595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.617 [2024-10-16 07:25:58.370818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.617 [2024-10-16 07:25:58.370938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.617 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.371053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.371341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.371554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.371805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.371950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.372050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.372317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.372606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.372871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.372992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.373136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.373376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.373580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.373826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.373978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.374094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.374364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.374591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.374836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.374973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.375097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.375323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.375582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.375857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.375976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.376089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.376361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.376600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.376871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.376984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.377129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.377358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.377559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.377766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.618 [2024-10-16 07:25:58.377892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.378038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.618 [2024-10-16 07:25:58.378063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.618 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.378184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.378400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.378672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.378815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.378911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.379167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.379403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.379664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.379808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.379927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.380131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.380370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.380571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.380775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.380920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.381044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.381307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.381540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.381776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.381894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.381980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.382242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.382508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.382741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.382884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.382983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.383258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.383462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.383742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.383884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.383976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.384215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.384507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.384767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.384889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.384980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.385103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.619 [2024-10-16 07:25:58.385128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.619 qpair failed and we were unable to recover it. 00:27:55.619 [2024-10-16 07:25:58.385225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.385498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.385756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.385909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.386033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.386235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.386503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.386800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.386911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.387026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.387291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.387529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.387758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.387932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.388021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.388274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.388576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.388851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.388971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.389085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.389380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.389606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.389888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.389977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.390105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.390394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.390621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.390887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.390994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.391091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.391390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.391656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.391888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.391985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.392103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.392338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.392549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.620 qpair failed and we were unable to recover it. 00:27:55.620 [2024-10-16 07:25:58.392778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.620 [2024-10-16 07:25:58.392897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.392923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.393012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.393280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.393513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.393841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.393982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.394070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.394288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.394496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.394811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.394930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.395012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.395242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.395478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.395715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.395844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.395948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.396174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.396405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.396606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.396857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.396979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.397069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.397280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.397535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.397760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.397874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.397996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.398270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.398541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.398774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.398895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.399011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.399287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.399513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.399775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.399886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.621 qpair failed and we were unable to recover it. 00:27:55.621 [2024-10-16 07:25:58.400031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.621 [2024-10-16 07:25:58.400160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.400278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.400483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.400714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.400862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.400996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.401221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.401409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.401662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.401871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.401976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.402129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.402386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.402647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.402885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.402993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.403140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.403326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.403584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.403782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.403885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.403973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.404212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.404436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.404663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.404899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.404986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.405128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.405385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.405588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.405787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.405925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.406046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.406281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.406546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.406778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.406922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.622 qpair failed and we were unable to recover it. 00:27:55.622 [2024-10-16 07:25:58.407016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.622 [2024-10-16 07:25:58.407094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.407266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.407497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.407742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.407877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.407974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.408247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.408503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.408800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.408911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.409263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.409527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.409746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.409867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.409981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.410252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.410500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.410785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.410904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.410986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.411242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.411461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.411688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.411828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.411918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.412148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.412412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.412652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.412830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.412949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.413041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.413067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.413157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.413269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.413294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.623 qpair failed and we were unable to recover it. 00:27:55.623 [2024-10-16 07:25:58.413416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.623 [2024-10-16 07:25:58.413520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.413544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.413662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.413748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.413774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.413893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.414176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.414389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.414619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.414854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.414975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.415099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.415354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.415593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.415852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.415985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.416075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.416333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.416541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.416773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.416888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.416986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.417236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.417490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.417719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.417881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.418008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.418260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.418494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.418738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.418853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.418947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.419177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.419445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.419670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.419791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.419937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.420157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.420414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.624 qpair failed and we were unable to recover it. 00:27:55.624 [2024-10-16 07:25:58.420672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.624 [2024-10-16 07:25:58.420796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.420889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.421189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.421414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.421637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.421798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.421887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.422132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.422380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.422625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.422773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.422860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.423152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.423411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.423679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.423787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.423902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.424168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.424391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.424584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.424835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.424986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.425107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.425327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.425524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.425772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.425923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.426070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.426322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.426590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.426898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.426991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.427113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.427341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.427600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.427836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.427977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.625 [2024-10-16 07:25:58.428126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.428211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.625 [2024-10-16 07:25:58.428236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.625 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.428350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.428578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.428817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.428925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.429048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.429329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.429641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.429784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.429912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.430151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.430401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.430634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.430783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.430907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.431131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.431418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.431662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.431902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.431995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.432141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.432398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.432630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.432835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.432983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.433100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.433416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.433646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.433776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.433894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.434158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.434392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.434643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.434857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.434973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.435105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.435330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.435562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.626 [2024-10-16 07:25:58.435686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.626 qpair failed and we were unable to recover it. 00:27:55.626 [2024-10-16 07:25:58.435783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.435869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.435894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.436010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.436233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.436437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.436695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.436845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.436972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.437251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.437480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.437688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.437831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.437954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.438211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.438471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.438706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.438854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.438976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.439230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.439489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.439777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.439926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.440049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.440290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.440488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.440774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.440888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.441007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.441206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.441437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.441635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.441849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.441991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.627 [2024-10-16 07:25:58.442112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.442229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.627 [2024-10-16 07:25:58.442254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.627 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.442379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.442460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.442485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.442600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.442742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.442768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.442894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.443200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.443470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.443703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.443826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.443949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.444216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.444479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.444740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.444845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.444969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.445207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.445474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.445686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.445846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.445929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.446165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.446403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.446670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.446792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.446946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.447168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.447437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.447670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.447843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.447967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.448229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.448449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.448703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.448827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.448941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.449178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.449407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.449641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.628 [2024-10-16 07:25:58.449779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.628 qpair failed and we were unable to recover it. 00:27:55.628 [2024-10-16 07:25:58.449927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.450197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.450399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.450601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.450853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.450966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.451062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.451292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.451540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.451800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.451905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.452023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.452265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.452531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.452763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.452873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.452966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.453168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.453397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.453686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.453805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.453925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.454155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.454422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.454627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.454801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.454890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.455156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.455422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.455680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.455875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.455983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.456101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.456325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.456610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.456831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.456974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.629 qpair failed and we were unable to recover it. 00:27:55.629 [2024-10-16 07:25:58.457092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.629 [2024-10-16 07:25:58.457184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.457339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.457547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.457797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.457913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.458007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.458270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.458521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.458749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.458895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.458977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.459181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.459469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.459706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.459832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.459949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.460206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.460466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.460756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.460873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.460993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.461249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.461519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.461786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.461925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.462020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.462266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.462530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.462777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.462916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.463038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.463274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.463496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.463760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.463885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.463968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.464232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.630 qpair failed and we were unable to recover it. 00:27:55.630 [2024-10-16 07:25:58.464500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.630 [2024-10-16 07:25:58.464651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.464755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.464897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.464923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.465059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.465350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.465579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.465819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.465956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.466043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.466280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.466559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.466846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.466968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.467086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.467335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.467596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.467810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.467926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.468045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.468255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.468487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.468690] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:55.631 [2024-10-16 07:25:58.468735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468816] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:55.631 [2024-10-16 07:25:58.468817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468837] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:55.631 [2024-10-16 07:25:58.468843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 [2024-10-16 07:25:58.468851] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.468934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.468908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:55.631 [2024-10-16 07:25:58.468986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:55.631 [2024-10-16 07:25:58.468983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:55.631 [2024-10-16 07:25:58.469085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 [2024-10-16 07:25:58.468954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.469208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.469420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.469645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.469887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.469978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.470096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.470345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.470551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.631 qpair failed and we were unable to recover it. 00:27:55.631 [2024-10-16 07:25:58.470785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.631 [2024-10-16 07:25:58.470881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.470906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.470995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.471204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.471413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.471687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.471802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.471924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.472132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.472328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.472542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.472740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.472846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.472932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.473159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.473358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.473557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.473769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.473883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.473971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.474192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.474412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.474666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.474882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.474997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.475102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.475322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.475541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.475753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.475871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.475957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.476178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.476395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.476632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.476833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.476941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.632 [2024-10-16 07:25:58.477053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.477166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.632 [2024-10-16 07:25:58.477190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.632 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.477284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.477488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.477741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.477860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.477998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.478207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.478437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.478651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.478878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.478991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.479104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.479330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.479535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.479792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.479905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.479990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.480223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.480423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.480672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.480885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.480997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.481105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.481309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.481550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.481829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.481937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.482055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.482316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.482513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.482711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.482837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.482920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.483142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.483338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.483567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.483847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.633 [2024-10-16 07:25:58.483965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.633 qpair failed and we were unable to recover it. 00:27:55.633 [2024-10-16 07:25:58.484048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.484255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.484455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.484656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.484884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.484999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.485109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.485337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.485562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.485797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.485921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.486010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.486205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.486437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.486669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.486780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47c0000b90 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.486937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.487223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.487417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.487624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.487840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.487968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.488092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.488324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.488585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.488799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.488908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.489019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.489242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.489446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.489686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.489814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.489966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.490174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.490466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.490661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.634 qpair failed and we were unable to recover it. 00:27:55.634 [2024-10-16 07:25:58.490859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.634 [2024-10-16 07:25:58.490945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.490970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.491078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.491314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.491558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.491780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.491887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.492005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.492198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.492462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.492677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.492800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.492885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.493128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.493380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.493714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.493859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.493954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.494227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.494457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.494648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.494879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.494987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.495081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.495309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.495513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.495771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.495894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.495994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.496244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.496482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.496749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.496888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.496981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.497186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.497484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.497720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.497880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.497965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.498171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.498393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.635 qpair failed and we were unable to recover it. 00:27:55.635 [2024-10-16 07:25:58.498630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.635 [2024-10-16 07:25:58.498762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.498787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.498882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.498970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.498994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.499076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.499326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.499552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.499762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.499875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.499968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.500207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.500448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.500710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.500835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.500922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.501147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.501354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.501570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.501840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.501977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.502105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.502301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.502540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.502812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.502924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.503042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.503257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.636 qpair failed and we were unable to recover it. 00:27:55.636 [2024-10-16 07:25:58.503481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.636 [2024-10-16 07:25:58.503595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.503680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.503812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.503839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.503924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.504153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.504385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.504621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.504802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.504887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.505150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.505374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.505634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.637 [2024-10-16 07:25:58.505758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.637 qpair failed and we were unable to recover it. 00:27:55.637 [2024-10-16 07:25:58.505852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.505938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.505962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.506073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.506272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.506480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.506683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.506879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.506978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.507090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.507322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.507517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.507713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.507833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.507933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.508019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.912 [2024-10-16 07:25:58.508043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.912 qpair failed and we were unable to recover it. 00:27:55.912 [2024-10-16 07:25:58.508136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.508342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.508553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.508801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.508906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.508997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.509217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.509477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.509685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.509828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.509921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.510137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.510352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.510580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.510777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.510889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.511005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.511208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.511498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.511785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.511898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.511982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.512241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.512480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.512697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.512851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.512942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.513162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.513357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.513574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.513793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.513975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.514091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.514334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.514564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.514809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.514927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.913 qpair failed and we were unable to recover it. 00:27:55.913 [2024-10-16 07:25:58.515018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.515132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.913 [2024-10-16 07:25:58.515157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.515249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.515439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.515665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.515822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.515921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.516141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.516387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.516643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.516879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.516986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.517092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.517321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.517581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.517805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.517974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.518064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.518282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.518532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.518769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.518938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.519062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.519262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.519454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.519673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.519819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.519918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.520176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.520395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.520610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.520771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.520886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.521127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.521355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.521562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.521910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.522007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.522137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.522160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.914 qpair failed and we were unable to recover it. 00:27:55.914 [2024-10-16 07:25:58.522275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.914 [2024-10-16 07:25:58.522363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.522389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.522509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.522626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.522650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.522759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.522844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.522868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.522958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.523183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.523632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.523858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.523977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.524069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.524270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.524497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.524699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.524814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.524931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.525193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.525394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.525630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.525750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.525947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.526184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.526414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.526617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.526896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.526990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.527111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.527332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.527553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.527749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.527890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.527982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.528210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.528465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.528694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.528865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.528950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.529048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.529073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.915 [2024-10-16 07:25:58.529160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.529241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.915 [2024-10-16 07:25:58.529266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.915 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.529367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.529558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.529797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.529938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.530055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.530281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.530537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.530775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.530915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.531058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.531285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.531476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.531682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.531813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.531932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.532171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.532383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.532635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.532867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.532982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.533128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.533323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.533556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.533797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.533903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.534022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.534266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.534487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.534691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.534806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.534899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.535049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.535073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.535167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.535283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.916 [2024-10-16 07:25:58.535308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.916 qpair failed and we were unable to recover it. 00:27:55.916 [2024-10-16 07:25:58.535424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.535546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.535570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.535687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.535785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.535810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.535931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.536194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.536429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.536658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.536902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.536984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.537107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.537302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.537541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.537802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.537923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.538010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.538270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.538501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.538762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.538891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.539011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.539245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.539489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.539724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.539836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.539924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.540131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.540358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.540561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.540816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.540953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.541042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.541290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.541541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.541769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.541907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.542034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.542120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.542145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.917 qpair failed and we were unable to recover it. 00:27:55.917 [2024-10-16 07:25:58.542240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.917 [2024-10-16 07:25:58.542327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.542351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.542461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.542575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.542599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.542719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.542812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.542836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.542961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.543168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.543457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.543677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.543818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.543909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.544145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.544376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.544799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.544914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.545002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.545194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.545432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.545629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.545786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.545904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.546141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.546351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.546571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.546792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.546935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.547052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.547308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.547530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.547776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.547924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.548010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.548238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.548470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.548677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.548793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.548938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.549029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.549053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.549146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.549257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.918 [2024-10-16 07:25:58.549281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.918 qpair failed and we were unable to recover it. 00:27:55.918 [2024-10-16 07:25:58.549366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.549476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.549500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.549613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.549725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.549754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.549878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.549975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.550087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.550334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.550531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.550826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.550974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.551072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.551334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.551530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.551768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.551881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.551979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.552241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.552436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.552651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.552801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.552921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.553203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.553462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.553696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.553829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.553920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.554225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.554456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.554686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.554844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.554944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.555164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.555373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.555595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.555852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.555962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.556091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.556178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.556202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.556291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.556409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.556433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.919 qpair failed and we were unable to recover it. 00:27:55.919 [2024-10-16 07:25:58.556551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.919 [2024-10-16 07:25:58.556638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.556662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.556772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.556859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.556884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.556981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.557221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.557412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.557663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.557870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.557989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.558128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.558381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.558576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.558793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.558940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.559026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.559229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.559449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.559689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.559811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.559918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.560184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.560399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.560629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.560900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.560989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.561127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.561356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.561557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.561762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.561932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.562020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.562272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.562472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.562742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.562883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.562977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.563064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.563088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.563204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.563319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.920 [2024-10-16 07:25:58.563344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.920 qpair failed and we were unable to recover it. 00:27:55.920 [2024-10-16 07:25:58.563435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.563644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.563876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.563995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.564088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.564317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.564551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.564819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.564960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.565053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.565355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.565563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.565798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.565942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.566066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.566326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.566555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.566786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.566907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.566998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.567211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.567481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.567678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.567797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.567885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.568109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.568373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.568604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.568850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.568967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.569054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.569170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.569197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.569295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.569409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.569434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.921 qpair failed and we were unable to recover it. 00:27:55.921 [2024-10-16 07:25:58.569527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.921 [2024-10-16 07:25:58.569613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.569642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.569752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.569852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.569879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.569975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.570184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.570388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.570648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.570889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.570989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.571160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.571403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.571596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.571839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.571949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.572052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.572308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.572550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.572857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.572972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.573070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.573278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.573481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.573758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.573876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.573963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.574192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.574426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.574663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.574882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.574999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.575151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.575345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.575632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.575901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.575991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.576167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.576379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.922 qpair failed and we were unable to recover it. 00:27:55.922 [2024-10-16 07:25:58.576647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.922 [2024-10-16 07:25:58.576766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.576860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.576948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.576972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.577073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.577301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.577501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.577702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.577849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.577936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.578200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.578418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.578623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.578865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.578980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.579102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.579359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.579570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.579839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.579949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.580042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.580234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.580477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.580741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.580855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.580942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.581151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.581354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.581575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.581803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.581918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.582020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.582220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.582443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.582697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.582824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.582913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.583147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.583374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.923 [2024-10-16 07:25:58.583484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.923 qpair failed and we were unable to recover it. 00:27:55.923 [2024-10-16 07:25:58.583573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.583660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.583686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.583819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.583911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.583936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.584055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.584276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.584481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.584671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.584795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.584881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.585131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.585326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.585546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.585738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.585887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.585974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.586233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.586465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.586657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.586895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.586982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.587095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.587297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.587526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.587748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.587885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.587973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.588225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.588478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.588735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.588870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.588951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.589144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.589382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.589609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.589876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.589992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.590107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.590188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.590213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.924 [2024-10-16 07:25:58.590297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.590411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.924 [2024-10-16 07:25:58.590435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.924 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.590535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.590629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.590653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.590786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.590901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.590926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.591012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.591246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.591501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.591702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.591827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.591928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.592172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.592399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.592600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.592851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.592984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.593105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.593339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.593569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.593835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.593972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.594067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.594272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.594464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.594685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.594834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.594954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.595239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.595465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.595706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.595820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.595906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.596140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.596339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.596588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.925 [2024-10-16 07:25:58.596734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.925 qpair failed and we were unable to recover it. 00:27:55.925 [2024-10-16 07:25:58.596882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.596968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.596992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.597091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.597330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.597536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.597735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.597852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.597969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.598216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.598469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.598705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.598900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.598991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.599220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.599420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.599646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.599882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.599995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.600109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.600369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.600563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.600808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.600951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.601048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.601244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.601466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.601707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.601829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.601913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.602140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.602351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.602607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.602815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.602921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.603010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.603253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.603462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.926 qpair failed and we were unable to recover it. 00:27:55.926 [2024-10-16 07:25:58.603688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.926 [2024-10-16 07:25:58.603782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.603807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.603926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.604126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.604329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.604554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.604763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.604872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.604984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.605216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.605438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.605669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.605804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.605950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.606184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.606383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.606578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.606843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.606958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.607049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.607302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.607500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.607760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.607870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.607956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.608148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.608339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.608584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.608801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.608915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.609015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.609212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.609405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.609657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.609872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.609975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.610071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.610217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.610241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.610331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.610414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.927 [2024-10-16 07:25:58.610439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.927 qpair failed and we were unable to recover it. 00:27:55.927 [2024-10-16 07:25:58.610525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.610620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.610646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.610772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.610867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.610892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.610971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.611181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.611432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.611632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.611837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.611941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.612037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.612230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.612455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.612686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.612806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.612955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.613165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.613480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.613706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.613830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.613924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.614190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.614416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.614610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.614833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.614943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.615045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.615562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.615771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.615884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.615985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.616238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.616464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.616660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.616785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.616902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.617187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.928 [2024-10-16 07:25:58.617389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.928 [2024-10-16 07:25:58.617525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.928 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.617646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.617724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.617757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.617872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.618184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.618377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.618643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.618881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.618991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.619073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.619263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.619492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.619738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.619872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.620027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.620223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.620513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.620722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.620851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.620965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.621193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.621400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.621615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.621829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.621970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.622063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.622266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.622525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.622747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.622862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.622974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.623233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.623467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.623693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.623834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.929 qpair failed and we were unable to recover it. 00:27:55.929 [2024-10-16 07:25:58.623917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.624033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.929 [2024-10-16 07:25:58.624057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.624150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.624368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.624622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.624874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.624980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.625094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.625316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.625568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.625766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.625877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.626001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.626225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.626466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.626705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.626849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.626941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.627149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.627388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.627584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.627795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.627921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.628042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.628243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.628463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.628686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.628820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.628938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.629166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.629370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.629602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.629869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.629983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.630098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.630309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.630569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.930 [2024-10-16 07:25:58.630779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.930 [2024-10-16 07:25:58.630892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.930 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.630981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.631255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.631459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.631658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.631773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.631895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.632158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.632360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.632559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.632793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.632909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.633035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.633224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.633456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.633681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.633790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.633905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.634126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.634320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.634547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.634755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.634895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.634981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.635227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.635454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.635708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.635851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.635971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.636189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.636421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.636625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.636881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.636999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.637110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.637386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.637598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.931 qpair failed and we were unable to recover it. 00:27:55.931 [2024-10-16 07:25:58.637854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.931 [2024-10-16 07:25:58.637948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.637981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.638068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.638276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.638507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.638715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.638843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.638936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.639143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.639372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.639626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.639856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.639995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.640083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.640339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.640538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.640769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.640887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.640987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.641188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.641428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.641658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.641900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.641985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.642089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.642283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.642513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.642752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.642862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.642955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.643168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.643363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.643600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.643832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.643951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.644065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.644267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.932 [2024-10-16 07:25:58.644500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.932 [2024-10-16 07:25:58.644609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.932 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.644724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.644817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.644842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.644960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.645226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.645450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.645677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.645886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.645992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.646110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.646367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.646589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.646816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.646955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.647080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.647321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.647526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.647769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.647933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.648019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.648245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.648444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.648683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.648914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.648999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.649141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.649372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.649573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.649812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.649929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.650018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.650250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.650474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.650708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.650837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.650921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.651109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.651303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.933 qpair failed and we were unable to recover it. 00:27:55.933 [2024-10-16 07:25:58.651567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.933 [2024-10-16 07:25:58.651655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.651679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.651771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.651855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.651880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.651970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.652198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.652421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.652712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.652830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.652924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.653131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.653336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.653535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.653752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.653889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.654009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.654247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.654454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.654669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.654793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.654912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.655114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.655385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.655608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.655842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.655947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.656070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.656277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.656475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.656675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.656826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.656918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.657140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.934 qpair failed and we were unable to recover it. 00:27:55.934 [2024-10-16 07:25:58.657337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.934 [2024-10-16 07:25:58.657483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.657595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.657684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.657709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.657834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.657919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.657943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.658041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.658292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.658503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.658757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.658903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.658998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.659221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.659416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.659616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.659833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.659942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.660045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.660270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.660493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.660743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.660854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.660957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.661192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.661384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.661618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.661832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.661996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.662107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.662311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.662515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.662745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.662851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.662943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.663199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.663438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.663656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.663852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.663970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.664151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.935 [2024-10-16 07:25:58.664176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.935 qpair failed and we were unable to recover it. 00:27:55.935 [2024-10-16 07:25:58.664268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.664492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.664720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.664856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.664962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.665179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.665432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.665689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.665907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.665997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.666110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.666336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.666565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.666765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.666879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.666995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.667224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.667462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.667672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.667883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.667992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.668106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.668340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.668536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.668744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.668911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.668996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.669197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.669427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.669653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.669900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.669989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.670127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.670316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.670514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.670784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.670888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.936 qpair failed and we were unable to recover it. 00:27:55.936 [2024-10-16 07:25:58.670978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.936 [2024-10-16 07:25:58.671057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.671170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.671424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.671649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.671848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.671986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.672074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.672271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.672506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.672763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.672875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.672990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.673246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.673441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.673675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.673803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.673925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.674166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.674415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.674615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.674829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.674973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.675071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.675269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.675495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.675688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.675846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.675965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.676166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.676658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.676916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.676997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.677140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.677368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.677595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.937 [2024-10-16 07:25:58.677824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.937 [2024-10-16 07:25:58.677935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.937 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.678032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.678234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.678512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.678787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.678904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.679018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.679214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.679434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.679625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.679826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.679943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.680036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.680235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.680428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.680673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.680806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.680897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.681156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.681350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.681604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.681816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.681935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.682047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.682277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.682477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.682740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.682849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.682934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.683153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.683361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.683557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.938 qpair failed and we were unable to recover it. 00:27:55.938 [2024-10-16 07:25:58.683767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.938 [2024-10-16 07:25:58.683913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.683998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.684218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.684420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.684661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.684795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.684886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.685139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.685336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.685561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.685905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.685986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.686214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.686473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.686674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.686825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.686918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.687160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.687384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.687617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.687846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.687981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.688071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.688266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.688500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.688710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.688886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.688970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.689204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.689435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.689646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.689802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.689923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.690120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.690405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.690643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.939 [2024-10-16 07:25:58.690761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.939 qpair failed and we were unable to recover it. 00:27:55.939 [2024-10-16 07:25:58.690906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.690994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.691133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.691338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.691549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.691778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.691888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.691972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.692201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.692389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.692625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.692786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.692877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.693137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.693350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.693547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.693785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.693893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.694005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.694194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.694398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.694622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.694861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.694972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.695096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.695294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.695486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.695748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.695857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.695981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.696180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.696441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.696692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.696811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.696925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.697162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.697352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.940 qpair failed and we were unable to recover it. 00:27:55.940 [2024-10-16 07:25:58.697590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.940 [2024-10-16 07:25:58.697675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.697699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.697795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.697880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.697904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.698043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.698244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.698436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.698690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.698886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.698990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.699114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.699320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.699537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.699786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.699899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.700015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.700292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.700518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.700762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.700903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.700993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.701251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.701454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.701664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.701811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.701929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.702155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.702348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.702600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.702878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.702993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.703141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.703358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.703655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.703771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.703890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.704113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.704336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.941 qpair failed and we were unable to recover it. 00:27:55.941 [2024-10-16 07:25:58.704532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.941 [2024-10-16 07:25:58.704643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.704746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.704892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.704917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.705006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.705214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.705441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.705642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.705878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.705997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.706118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.706316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.706517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.706754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.706899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.706985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.707224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.707457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.707678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.707800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.707889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.708119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.708348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.708547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.708785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.708909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.709005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.709237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.709441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.709700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.709822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.709918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.710186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.710410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.942 qpair failed and we were unable to recover it. 00:27:55.942 [2024-10-16 07:25:58.710611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.942 [2024-10-16 07:25:58.710701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.710733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.710855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.710940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.710965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.711121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.711370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.711567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.711780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.711896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.712016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.712274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.712471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.712661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.712868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.712992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b8000b90 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.713150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.713381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.713573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.713800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.713919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.714051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.714270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.714480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.714708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.714839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.714932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.715131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.715320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.715544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.715769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.715888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.715991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.716227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.716485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.716697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.716846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.716934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.717134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.943 [2024-10-16 07:25:58.717369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.943 [2024-10-16 07:25:58.717537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.943 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.717625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.717743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.717768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.717852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.717939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.717964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.718061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.718265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.718503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.718762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.718873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.718968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.719176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.719429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.719638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.719849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.719986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.720072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.720307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.720546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.720773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.720889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.720976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.721238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.721444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.721678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.721846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.721939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.722152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.722431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.722657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.722893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.722983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.723129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.723336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.723533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.723755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.723863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.723976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.724197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.944 qpair failed and we were unable to recover it. 00:27:55.944 [2024-10-16 07:25:58.724414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.944 [2024-10-16 07:25:58.724554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.724702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.724791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.724816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.724902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.724988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.725097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.725316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.725536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.725771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.725918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.725997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.726219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.726667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.726892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.726978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.727085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.727351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.727541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.727816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.727929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.728044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.728276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.728526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.728754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.728868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.728956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.729194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.729397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.729617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.729816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.729923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.730014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.730204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.730440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.730726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.730872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.730959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.731081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.731105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.945 [2024-10-16 07:25:58.731192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.731282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.945 [2024-10-16 07:25:58.731306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.945 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.731402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.731634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.731850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.731962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.732058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.732276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.732488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.732755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.732864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.732960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.733228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.733443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.733651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.733904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.733989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.734132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.734370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.734567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.734794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.734907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.734995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.735198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.735429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.735628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.735838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.735950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.736067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.736300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.736556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.736761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.736880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.736970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.737167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.737397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.737627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.737832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.737967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.946 qpair failed and we were unable to recover it. 00:27:55.946 [2024-10-16 07:25:58.738084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.738174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.946 [2024-10-16 07:25:58.738199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.738310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.738517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.738748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.738892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.738976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.739232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.739453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.739711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.739831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.739921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.740143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.740361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.740584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.740804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.740915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.741041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.741242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.741477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.741741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.741852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.741948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.742149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.742411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.742612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.742836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.742949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.743059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.743282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.743539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.743751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.743860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.743952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.744036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.744060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.947 [2024-10-16 07:25:58.744191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.744277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.947 [2024-10-16 07:25:58.744301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.947 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.744401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.744606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.744801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.744911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.744997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.745275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.745480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.745678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.745877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.745984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.746098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.746293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.746546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.746751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.746890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.746974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.747205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.747424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.747620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.747819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.747957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.748040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.748288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.748512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.748708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.748837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.748918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.749156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.749382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.749580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.749846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.749960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.750047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.750245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.750473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.750697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.948 qpair failed and we were unable to recover it. 00:27:55.948 [2024-10-16 07:25:58.750915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.750999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.948 [2024-10-16 07:25:58.751023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.751104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.751330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.751597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.751828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.751931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.752010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.752268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.752518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.752750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.752923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.753041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.753261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.753465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.753693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.753868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.753987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.754222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.754449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.754659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.754870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.754976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.755095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.755322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.755526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.755753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.755863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.755959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.756192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.756429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.756686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.756817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.756935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.757158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.757344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.757567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.757806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.757919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.949 qpair failed and we were unable to recover it. 00:27:55.949 [2024-10-16 07:25:58.758014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.949 [2024-10-16 07:25:58.758131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.758277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.758513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.758739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.758880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.758968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.759229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.759425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.759617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.759842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.759945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.760067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.760302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.760603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.760861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.760980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.761059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.761264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.761474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.761666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.761807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.761929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.762129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.762327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.762561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.762793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.762909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.763023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.763277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.763462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.763654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.763778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.763894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.764019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.764042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.764160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.764251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.764275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.950 qpair failed and we were unable to recover it. 00:27:55.950 [2024-10-16 07:25:58.764370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.950 [2024-10-16 07:25:58.764452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.764477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.764570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.764693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.764717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.764872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.764980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.765091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.765375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.765636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.765869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.765982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.766091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.766354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.766607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.766847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.766948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.767033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.767229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.767489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.767688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.767837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.767924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.768150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.768365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.768552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.768766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.768879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.768980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.769184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.769383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.769622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.769769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.769888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.770010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.770034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.770151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.770238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.770262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.951 qpair failed and we were unable to recover it. 00:27:55.951 [2024-10-16 07:25:58.770358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.951 [2024-10-16 07:25:58.770471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.770497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.770585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.770699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.770724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.770824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.770903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.770927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.771013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.771269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.771463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.771688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.771901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.771982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.772092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.772358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.772616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.772888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.772989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.773106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.773334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.773527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.773753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.773890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.773972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.774174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.774395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.774630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.774864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.774975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.775101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.775309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.775531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.775766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.775877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.775987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.776188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.776421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.776644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.776881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.776994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.777074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.777182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.952 [2024-10-16 07:25:58.777206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.952 qpair failed and we were unable to recover it. 00:27:55.952 [2024-10-16 07:25:58.777296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.777493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.777708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.777844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.777931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.778189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.778421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.778634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.778904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.778993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.779103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.779323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.779586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.779838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.779943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.780032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.780263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.780510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.780700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.780822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.780917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.781120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.781368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.781568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.781851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.781966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.782051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.782245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.782503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.782722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.782847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.782936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.783191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.783400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.783628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.783862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.783976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.784000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.953 [2024-10-16 07:25:58.784083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.784196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.953 [2024-10-16 07:25:58.784220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.953 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.784332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.784521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.784754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.784865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.784952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.785200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.785391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.785652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.785850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.785952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.786037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.786227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.786502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.786738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.786858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.786972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.787166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.787361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.787613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.787857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.787999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.788114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.788345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.788600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.788837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.788979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.789070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.789293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.789482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.789705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.789825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.789929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.790160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.790364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.790559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.790762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.790875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.954 qpair failed and we were unable to recover it. 00:27:55.954 [2024-10-16 07:25:58.790996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.791083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.954 [2024-10-16 07:25:58.791106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.791198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.791433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.791635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.791836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.791946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.792060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.792296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.792525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.792750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.792858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.792973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.793218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.793403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.793597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.793789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.793928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.794019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.794274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.794499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.794767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.794873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.794994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.795215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.795469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.795663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.795904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.795987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.796126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.796329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.796550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.796809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.796912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.955 [2024-10-16 07:25:58.797034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.797120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.955 [2024-10-16 07:25:58.797144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.955 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.797229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.797427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.797656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.797863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.797967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.798056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.798338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.798573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.798783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.798903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.798994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.799190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.799455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.799707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.799822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.799906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.800127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.800319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.800513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.800739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.800886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.800968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.801165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.801384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.801619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.956 [2024-10-16 07:25:58.801818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.956 [2024-10-16 07:25:58.801938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.956 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.802030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.802233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.802471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.802692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.802814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.802930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.803166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.803367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.803564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.803776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.803883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.803964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.804167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.804358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.804639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.804841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.804978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.805094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.805299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.805561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.805791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.805898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.806025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.806248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.806483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.806735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.806847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.806932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.807160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.807429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.807628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.807766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.807885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.808116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.808313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.957 qpair failed and we were unable to recover it. 00:27:55.957 [2024-10-16 07:25:58.808547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.957 [2024-10-16 07:25:58.808661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.808685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.808776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.808892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.808917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.809040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.809295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.809544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.809746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.809854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.809937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.810189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.810420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.810668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.810885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.810995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.811135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.811325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.811545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.811741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.811846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.811929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.812150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.812370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.812623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.812842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.812967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.813081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.813303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.813529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.813747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.813868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.813953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.814178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.814378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.814606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.814835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.814947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.815034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.815115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.815139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.958 [2024-10-16 07:25:58.815287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.815377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.958 [2024-10-16 07:25:58.815400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.958 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.815487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.815570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.815594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.815683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.815770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.815795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.815879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.815992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.816109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.816294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.816526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.816746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.816858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.816979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.817207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.817436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.817657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.817854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.817993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.818116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.818323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.818548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.818738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.818846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.818939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.819197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.819416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.819666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.819874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.819990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.820099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.820330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.820550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.820744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.820912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.821006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.821233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.821437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.821665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.821902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.821989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.822014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.959 qpair failed and we were unable to recover it. 00:27:55.959 [2024-10-16 07:25:58.822104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.822196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.959 [2024-10-16 07:25:58.822221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.822306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.822508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.822763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.822907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.822992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.823202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.823437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.823633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.823834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.823955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.824074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.824271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.824519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.824772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.824888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.825003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.825193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.825386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.825610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.825874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.825993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.826134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.826358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.826560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.826752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.826860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.826948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.827154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.827348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.827567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.960 qpair failed and we were unable to recover it. 00:27:55.960 [2024-10-16 07:25:58.827768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.960 [2024-10-16 07:25:58.827863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.827887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.827974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.828191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.828414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.828661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.828855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.828966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.829056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.829282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.829516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.829773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.829887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.829973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.830227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.830450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.830649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.830763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.830877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.831127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.831359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.831566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.831803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.831936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.832064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.832265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.832490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.832677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.832803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.832890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.833123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.833322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.833556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.833794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.833930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.834050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.834135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.834159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.961 qpair failed and we were unable to recover it. 00:27:55.961 [2024-10-16 07:25:58.834256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.834340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.961 [2024-10-16 07:25:58.834364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.834451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.834559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.834583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.834702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.834817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.834843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.834924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.835129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.835355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.835618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.835816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.835985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.836069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.836288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.836512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.836701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.836825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.836918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.837143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.837373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.837622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.837884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.837983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.838007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.838104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.838187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.838211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:55.962 [2024-10-16 07:25:58.838301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.838386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.962 [2024-10-16 07:25:58.838410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:55.962 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.838500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.838627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.838651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.838740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.838858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.838882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.838978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.839172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.839370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.839567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.839815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.839934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.840053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.840245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.840474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.840674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.840899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.840981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.841005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.841126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.841204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.245 [2024-10-16 07:25:58.841229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.245 qpair failed and we were unable to recover it. 00:27:56.245 [2024-10-16 07:25:58.841319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.841515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.841709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.841855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.841947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.842170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.842371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.842561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.842772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.842878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.842965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.843191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.843396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.843684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.843794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.843913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.844115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.844363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.844602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.844832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.844941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.845031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.845213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.845411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.845637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.845868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.845972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.846056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.846283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.846510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.846771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.846887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.846974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.847223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.847453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.847647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.847849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.847953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.848035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.848294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.848522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.848732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.848843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.848992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.849210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.849462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.849683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.849874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.849984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.850065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.850295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.850513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.850741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.850885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.850966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.851178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.851371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.851579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.851816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.851956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.852043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.852276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.852495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.246 [2024-10-16 07:25:58.852687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.246 [2024-10-16 07:25:58.852839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.246 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.852927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.853158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.853359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.853603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.853822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.853938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.854062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.854258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.854488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.854751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.854869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.854986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.855413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.855605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.855838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.855953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.856070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.856271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.856503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.856759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.856874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.856960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.857185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.857441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.857668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.857896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.857982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.858101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.858388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.858646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.858859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.858962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.859050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.859269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.859492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.859717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.859869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.859961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.860161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.860348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.860550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.860774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.860912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.860997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.861194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.861414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.861681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.861797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.861918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.862139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.862386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.862603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.862779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.862895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.863131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.863417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.863655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.863909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.863992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.864130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.864388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.864619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.247 qpair failed and we were unable to recover it. 00:27:56.247 [2024-10-16 07:25:58.864870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.247 [2024-10-16 07:25:58.864954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.864978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.865069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.865267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.865504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.865722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.865863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.865974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.866205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.866442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.866630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.866783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.866928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.867153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.867375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.867608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.867860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.867973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.868060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.868311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.868516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.868738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.868857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.868951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.869169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.869388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.869594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.869822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.869946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.870089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.870314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.870500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.870748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.870854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.870950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.871207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.871468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.871695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.871816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.871901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.872193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.872445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.872692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.872906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.872991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.873109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.873324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.873511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.873758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.873901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.874017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.874246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.874466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.874689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.874837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.874957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.875044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.875070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.875187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.875285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.875310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.248 qpair failed and we were unable to recover it. 00:27:56.248 [2024-10-16 07:25:58.875427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.248 [2024-10-16 07:25:58.875549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.875574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.875687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.875780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.875805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.875924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.876150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.876365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.876614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.876783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.876905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.877138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.877378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.877602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.877845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.877951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.878062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.878256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.878511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.878744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.878886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.878972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.879188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.879387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.879607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.879841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.879956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.880041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.880312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.880510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.880749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.880892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.880978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.881190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.881394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.881641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.881892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.881979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.882083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.882295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.882521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.882710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.882851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.882942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.883138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.883338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.883559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.883790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.883932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.884047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.884298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.884518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.884740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.884873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.884998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.885186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.885379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.885632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.885888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.885979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.886110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.886316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.886516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.886804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.886909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.886996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.887222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.887474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.249 [2024-10-16 07:25:58.887640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.249 qpair failed and we were unable to recover it. 00:27:56.249 [2024-10-16 07:25:58.887737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.887818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.887842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.887964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.888193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.888416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.888661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.888794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.888919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.889207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.889399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.889604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.889846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.889960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.890045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.890305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.890493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.890775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.890917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.891040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.891296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.891528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.891732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.891836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.891924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.892129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.892355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.892616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.892828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.892939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.893025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.893288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.893531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.893719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.893868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.893955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.894211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.894475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.894739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.894852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.894935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.895136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.895333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.895562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.895802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.895923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.896037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.896248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.896455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.896648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.896889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.896996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.897107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.897321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.897513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.897745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.897864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.897958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.898212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.898447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.250 qpair failed and we were unable to recover it. 00:27:56.250 [2024-10-16 07:25:58.898656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.250 [2024-10-16 07:25:58.898773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.898799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.898883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.898979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.899126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.899321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.899536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.899768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.899871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.899970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.900166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.900378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.900605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.900807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.900922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.901018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.901275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.901500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.901693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.901904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.901994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.902104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.902356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.902577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.902777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.902892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.902983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.903222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.903450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.903638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.903850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.903960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.904072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.904326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.904536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.904734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.904839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.904927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.905155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.905357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.905584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.905818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.905931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.906044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.906300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.906497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.906752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.906902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.906990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.907224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.907440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.907638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.907846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.907961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.908047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.908277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.908506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.908761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.908873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.908962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.909173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.909377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.909628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.909838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.909975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.910060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.910150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.910176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.251 qpair failed and we were unable to recover it. 00:27:56.251 [2024-10-16 07:25:58.910290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.910373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.251 [2024-10-16 07:25:58.910397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.910489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.910581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.910605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.910686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.910776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.910801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.910920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.911200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.911405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.911668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.911862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.911967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.912057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.912285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.912536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.912774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.912878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.912958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.913154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.913348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.913583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.913800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.913943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.914020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.914245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.914469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.914707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.914881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.915002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.915195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.915425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.915659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.915771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.915883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.916146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.916352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.916614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.916867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.916988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.917098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.917327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.917554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.917755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.917897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.918013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.918245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.918541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.918762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.918877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.918977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.919194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.919386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.919617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.919832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.919975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.920062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.920324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.920562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.920796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.920904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.920989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.921188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.921444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.921691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.921842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.921922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.922141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.252 [2024-10-16 07:25:58.922346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.252 [2024-10-16 07:25:58.922450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.252 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.922569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.922659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.922683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.922780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.922865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.922892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.923003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.923255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.923509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.923769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.923906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.924000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.924254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.924445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.924633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.924861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.924971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.925120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.925351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.925546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.925738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.925879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.925962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.926186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.926413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.926610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.926845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.926983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.927103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.927324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.927544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.927804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.927943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.928033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.928227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.928423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.928678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.928881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.928986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.929069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.929297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.929549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.929780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.929911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.930031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.930232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.930486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.930709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.930830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.930946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.931166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.931363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.931584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.931851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.931990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.932087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.932282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.932534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.932817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.932926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.933014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.933091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.933116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.253 [2024-10-16 07:25:58.933238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.933380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.253 [2024-10-16 07:25:58.933405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.253 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.933493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.933580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.933604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.933695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.933815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.933840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.933956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.934179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.934439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.934643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.934867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.934975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.935069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.935268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.935525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.935757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.935869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.935962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.936194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.936393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.936619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.936832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.936970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.937054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.937242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.937476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.937757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.937912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.938002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.938259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.938492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.938678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.938881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.938996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.939160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.939408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.939603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.939821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.939926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.940025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.940222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.940451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.940660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.940884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.940991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.941085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.941295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.941536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.941776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.941890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.941975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.942205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.942458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.942666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.942863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.942978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.943062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.943292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.943548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.943821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.943958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.944055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.944282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.944513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.944753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.944872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.944992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.945108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.945133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.945216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.945326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.254 [2024-10-16 07:25:58.945351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.254 qpair failed and we were unable to recover it. 00:27:56.254 [2024-10-16 07:25:58.945461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.945546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.945570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.945711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.945866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.945892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.945988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.946258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.946474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.946671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.946878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.946984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.947089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.947278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.947533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.947771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.947884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.947971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.948192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.948394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.948644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.948879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.948986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.949097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.949319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.949513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.949770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.949881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.949973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.950178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.950373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.950580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.950782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.950895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.950988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.951241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.951458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.951720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.951844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.951925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.952122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.952343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.952571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.952797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.952935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.953034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.953230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.953429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.953672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.953815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.953921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.954145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.954374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.954567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.954835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.954942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.955040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.955269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.955514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.955777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.955880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.955960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.956050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.956074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.255 qpair failed and we were unable to recover it. 00:27:56.255 [2024-10-16 07:25:58.956190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.956311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.255 [2024-10-16 07:25:58.956335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.956431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.956621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.956869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.956974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.957061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.957295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.957518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.957763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.957875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.957961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.958162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.958368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.958596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.958833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.958949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.959066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.959300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.959533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.959757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.959904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.959993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.960255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.960487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.960709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.960852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.960939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.961222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.961418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.961645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.961860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.961997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.962097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.962305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.962526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.962749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.962859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.962969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.963190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.963440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.963661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.963809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.963928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.964128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.964313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.964505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.964767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.964878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.964969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.965180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.965401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.965599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.965834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.965984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.966069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.966260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.966496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.966700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.966816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.966976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.967054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.967079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.256 [2024-10-16 07:25:58.967163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.967247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.256 [2024-10-16 07:25:58.967271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.256 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.967355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.967580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.967786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.967922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.968014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.968235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.968515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.968760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.968870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.968967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.969176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.969373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.969589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.969819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.969955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.970048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.970303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.970490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.970712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.970830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.970950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.971190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.971433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.971657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.971794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.971912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.972141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.972372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.972573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.972766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.972915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.972999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.973230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.973458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.973685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.973838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.973931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.974125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.974317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.974548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.974805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.974924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.975037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.975259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.975519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.975732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.975870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.975963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.976184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.976406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.976628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.976855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.976991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.977078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.977305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.977522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.977739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.977852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.977943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.978214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.978455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.978712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.978864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.978956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.979210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.257 qpair failed and we were unable to recover it. 00:27:56.257 [2024-10-16 07:25:58.979518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.257 [2024-10-16 07:25:58.979661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.979780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.979892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.979916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.980009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.980212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.980500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.980720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.980847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.980940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.981140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.981377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.981639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.981876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.981980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.982101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.982362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.982604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.982802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.982945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.983034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.983297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.983524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.983756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.983892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.983977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.984207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.984425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.984653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.984882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.984997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.985117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.985362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.985600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.985845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.985958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.986059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.986273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.986476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.986736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.986857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.986959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.987153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.987414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.987632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.987887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.987975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.988086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.988320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.988585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.988814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.988931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.989054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.989277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.989459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.989700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.989845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.989954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.990217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.990440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.258 [2024-10-16 07:25:58.990722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.258 [2024-10-16 07:25:58.990848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.258 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.990933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.991160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.991388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.991585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.991821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.991940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.992058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.992292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.992496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.992758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.992875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.992971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.993204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.993436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.993654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.993865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.993967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.994084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.994313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.994541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.994777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.994891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.994981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.995212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.995436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.995660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.995801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.995920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.996125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.996356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.996587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.996967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.997058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.997260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.997503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.997701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.997833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.997923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.998117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.998327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.998520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.998754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.998894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.999016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.999233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.999435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.999648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:58.999854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:58.999959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.000079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.000297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.000526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.000745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.000851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.000945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.001208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.001463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.001659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.001832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.001948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.002176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.002369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.259 [2024-10-16 07:25:59.002472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.259 qpair failed and we were unable to recover it. 00:27:56.259 [2024-10-16 07:25:59.002564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.002645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.002669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.002782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.002875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.002900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.002984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.003204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.003430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.003684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.003880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.003998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.004082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.004267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.004492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.004698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.004917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.004999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.005137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.005388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.005601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.005836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.005941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.006057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.006321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.006568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.006770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.006881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.006978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.007235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.007489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.007708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.007903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.007989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.008127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.008330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.008561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.008858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.008992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.009086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.009301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.009511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.009760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.009871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.009988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.010209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.010435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.010687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.010896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.010981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.011096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.011350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.011541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.011799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.011971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.012062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.012320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.012537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.012737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.012847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.012946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.013140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.013378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.013579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.013776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.013885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.013974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.014057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.014082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.014163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.014243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.014267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.260 qpair failed and we were unable to recover it. 00:27:56.260 [2024-10-16 07:25:59.014358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.260 [2024-10-16 07:25:59.014452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.014477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.014564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.014640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.014665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.014790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.014873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.014897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.015010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.015205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.015430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.015676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.015878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.015989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.016103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.016333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.016583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.016821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.016960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.017041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.017321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.017553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.017760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.017872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.017962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.018192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.018427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.018654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.018858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.018999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.019095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.019326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.019560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.019752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.019861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.019955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.020182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.020370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.020596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.020805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.020909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.021001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.021261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.021519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.021738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.021846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.021960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.022161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.022409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.022680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.022889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.022983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.023120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.023350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.023548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.023794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.023901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.023993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.024221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.024432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.024670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.024886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.024992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.025116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.025202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.025227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.261 [2024-10-16 07:25:59.025318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.025394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.261 [2024-10-16 07:25:59.025418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.261 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.025503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.025598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.025622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.025712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.025820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.025847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.025938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.026136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.026393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.026621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.026865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.026974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.027119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.027304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.027540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.027760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.027906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.027999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.028230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.028453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.028660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.028774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.028863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.029123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.029308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.029527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.029751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.029889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.029988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.030193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.030389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.030630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.030848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.030966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.031055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.031290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.031546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.031803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.031972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.032057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.032285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.032516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.032746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.032863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.032952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.033206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.033404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.033668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.033916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.033996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.034136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.034360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.034615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.034817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.034925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.035048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.035282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.035502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.035737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.035862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.035948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.036170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.036401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.036660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.036895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.036984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.037100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.037302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.262 [2024-10-16 07:25:59.037526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.262 [2024-10-16 07:25:59.037629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.262 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.037716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.037834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.037858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.037944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.038206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.038437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.038626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.038864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.038970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.039060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.039289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.039507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.039734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.039848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.039932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.040172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.040373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.040625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.040825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.040967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.041055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.041345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.041538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.041819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.041957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.042074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.042268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.042457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.042678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.042801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.042900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.043135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.043335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.043564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.043754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.043868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.043957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.044213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.044418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.044653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.044886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.044972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.045087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.045293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.045518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.045753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.045859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.045962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.046168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.046391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.046597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.046820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.046965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.047050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.047281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.047510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.047739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.047850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.047934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.048166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.263 qpair failed and we were unable to recover it. 00:27:56.263 [2024-10-16 07:25:59.048363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.263 [2024-10-16 07:25:59.048507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.048597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.048691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.048715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.048813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.048930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.048955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.049069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.049296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.049490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.049720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.049884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.049992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.050226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.050424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.050624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.050834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.050969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.051054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.051285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.051521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.051746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.051887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.051982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.052200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.052416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.052654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.052878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.052986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.053072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.053266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.053488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.053715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.053866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.053990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.054212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.054412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.054656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.054892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.054982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.055149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.055370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.055562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.055905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.056012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.056238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.056468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.056697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.056831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.056929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.057168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.057369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.057612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.057865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.057977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.058100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.058318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.058543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.058802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.058919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.059009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.059232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.059437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.059626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.059855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.059995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.060101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.060315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.264 qpair failed and we were unable to recover it. 00:27:56.264 [2024-10-16 07:25:59.060536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.264 [2024-10-16 07:25:59.060627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.060652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.060764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.060861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.060885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.060968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.061199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.061449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.061672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.061808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.061924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.062175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.062369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.062597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.062831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.062946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.063027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.063225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.063644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.063912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.063998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.064135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.064349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.064540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.064741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.064882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.064980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.065219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.065449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.065716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.065858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.065973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.066172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.066432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.066650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.066843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.066960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.067106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.067324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.067548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.067775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.067887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.067974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.068227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.068448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.068674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.068901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.068985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.069152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.069339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.069536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.069770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.069887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.069976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.070168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.070400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.070644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.070899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.070983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.071092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.071339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.071561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.071801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.071912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.072003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.072086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.072111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.265 qpair failed and we were unable to recover it. 00:27:56.265 [2024-10-16 07:25:59.072204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.072317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.265 [2024-10-16 07:25:59.072342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.072466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.072557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.072583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.072682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.072769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.072794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.072883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.072995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.073138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.073341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.073599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.073797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.073937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.074028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.074249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.074449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.074652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.074858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.074976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.075098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.075355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.075605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.075836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.075950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.076048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.076257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.076485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.076676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.076810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.076890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.077152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.077363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.077609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.077867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.077984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.078077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.078304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.078585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.078797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.078905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.078989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.079225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.079478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.079691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.079839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.079922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.080151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.080436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.080651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.080903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.080981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.081095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.081291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.081560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.081765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.081885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.081972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.082194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.082383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.082610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.082820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.082923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.083044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.083283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.083485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.266 qpair failed and we were unable to recover it. 00:27:56.266 [2024-10-16 07:25:59.083714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.266 [2024-10-16 07:25:59.083828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.083918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.084157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.084371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.084557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.084894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.084982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.085203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.085409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.085642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.085869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.085980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.086116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.086343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.086566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.086821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.086931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.087045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.087243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.087449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.087706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.087819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.087946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.088172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.088362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.088612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.088820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.088957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.089044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.089243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.089460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.089666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.089804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.089885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.090114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.090345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.090600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.090785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.090877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.091128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.091312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.091535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.091756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.091862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.091952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.092185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.092417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.092610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.092830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.092941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.093027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.093235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.093466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.093706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.093827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.093941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.094147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.094405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.094608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.094807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.094947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.095046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.095306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.095539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.267 qpair failed and we were unable to recover it. 00:27:56.267 [2024-10-16 07:25:59.095776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.267 [2024-10-16 07:25:59.095866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.095891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.096017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.096249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.096480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.096710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.096850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.096945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.097178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.097374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.097606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.097807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.097920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.098007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.098230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.098424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.098650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.098871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.098987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.099103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.099328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.099607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.099873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.099982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.100067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.100301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.100561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.100795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.100899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.100990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.101180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.101397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.101627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.101853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.101967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.102087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.102365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.102648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.102847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.102994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.103087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.103313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.103571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.103797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.103905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.103999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.104200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.104456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.104656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.104799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.104924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.105182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.105375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.105632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.105836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.105953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.106045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.106274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.106466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.106677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.106852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.268 qpair failed and we were unable to recover it. 00:27:56.268 [2024-10-16 07:25:59.106970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.107083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.268 [2024-10-16 07:25:59.107107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.107226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.107450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.107678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.107891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.107987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.108131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.108351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.108612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.108824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.108931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.109046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.109234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.109470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.109692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.109811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.109913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.110140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.110366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.110594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.110852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.110965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.111048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.111281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.111541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.111740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.111860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.111954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.112140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.112391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.112613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.112818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.112955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.113073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.113300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.113524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.113745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.113858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.113974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.114204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.114472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.114679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.114789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.114909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.115121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.115305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.115596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.115802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.115928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.116015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.116231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.116489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.116687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.116891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.116997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.117084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.117283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.117488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.117762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.117903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.117990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.118246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.118464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.118698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.269 [2024-10-16 07:25:59.118808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.269 qpair failed and we were unable to recover it. 00:27:56.269 [2024-10-16 07:25:59.118899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.118976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.119122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.119312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.119537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.119807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.119916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.120061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.120287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.120513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.120703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.120819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.120911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.121135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.121413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.121645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.121850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.121990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.122082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.122309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.122535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.122765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.122877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.122992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.123240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.123442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.123661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.123813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.123928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.124115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.124336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.124537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.124723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.124875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.124995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.125226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.125492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.125721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.125841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.125956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.126206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.126452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.126656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.126884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.126997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.127110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.127335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.127553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.127784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.127900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.127993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.128223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.128419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.128657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.128778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.128899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.129152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.129404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.129633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.129885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.129989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.130076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.130191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.130216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.130334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.130420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.270 [2024-10-16 07:25:59.130445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.270 qpair failed and we were unable to recover it. 00:27:56.270 [2024-10-16 07:25:59.130527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.130617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.130643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.130741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.130834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.130859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.130941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.131230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.131425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.131686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.131892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.131981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.132090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.132346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.132539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.132771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.132885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.132970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.133170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.133447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.133651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.133870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.133976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.134096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.134316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.134545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.134773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.134882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.134961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.135186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.135393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.135633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.135772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.135889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.136007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.136031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.136152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.136263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.136288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.271 qpair failed and we were unable to recover it. 00:27:56.271 [2024-10-16 07:25:59.136381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.271 [2024-10-16 07:25:59.136472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.136496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.136608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.136721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.136751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.136845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.136924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.136949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.137034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.137279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.137499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.137707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.137851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.137971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.138260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.138510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.138739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.138877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.138965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.139230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.139544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.139766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.139905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.140024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.140256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.140497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.140762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.140875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.140965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.141178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.141415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.141649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.141879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.141998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.142091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.142209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.142234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.142318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.142414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.272 [2024-10-16 07:25:59.142439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.272 qpair failed and we were unable to recover it. 00:27:56.272 [2024-10-16 07:25:59.142534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.142653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.142678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.142771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.142855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.142880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.142966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.143201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.143430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.143700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.143854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.143956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.144224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.144441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.144626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.144843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.144981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.145081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.145307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.145530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.145766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.145909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.146038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.146299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.146500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.146719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.146841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.146926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.147160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.147388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.147588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.147832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.147984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.148096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.148321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.148524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.273 [2024-10-16 07:25:59.148632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.273 qpair failed and we were unable to recover it. 00:27:56.273 [2024-10-16 07:25:59.148721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.148850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.148874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.149027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.149226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.149519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.149738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.149852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.149964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.150175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.150396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.150595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.150801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.150969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.151063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.151286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.151490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.151705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.151872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.151966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.152180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.152453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.152654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.152883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.152995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.153136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.153352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.153612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.153870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.153991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.154127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.154386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.154649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.154893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.154977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.155001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.274 [2024-10-16 07:25:59.155121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.155219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.274 [2024-10-16 07:25:59.155243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.274 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.155328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.155565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.155803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.155943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.156028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.156258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.156516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.156758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.156896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.156979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.157182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.157456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.157677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.157880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.157994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.158078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.158331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.158560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.158865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.158982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.159069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.159291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.159527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.159746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.159861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.159945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.160153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.275 [2024-10-16 07:25:59.160395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.275 [2024-10-16 07:25:59.160505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.275 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.160589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.160672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.160697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.160798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.160897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.160922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.161260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.161495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.161704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.161845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.161929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.162189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.162416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.162521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.276 [2024-10-16 07:25:59.162951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.163043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.276 [2024-10-16 07:25:59.163068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.276 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.163152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.163384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.163589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.163816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.163928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.164026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.164226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.164455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.164655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.164897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.164976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.165084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.165351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.165610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.165850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.165969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.166087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.166295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.166510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.166705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.166906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.166988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.167143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.167403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.167662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.167873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.167986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.168103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.168191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.168220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.168338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.168439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.555 [2024-10-16 07:25:59.168464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.555 qpair failed and we were unable to recover it. 00:27:56.555 [2024-10-16 07:25:59.168559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.168640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.168664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.168782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.168912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.168938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.169051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.169271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.169506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.169724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.169896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.170040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.170313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.170543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.170810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.170953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.171042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.171304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.171559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.171813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.171930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.172015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.172255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.172559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.172805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.172909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.173115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.173322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.173555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.173772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.173880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.173963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.174288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.174515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.174825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.174938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.175019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.175267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.175459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.175691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.175833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.556 qpair failed and we were unable to recover it. 00:27:56.556 [2024-10-16 07:25:59.176029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.556 [2024-10-16 07:25:59.176133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.176268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.176508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.176717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.176896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.176991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.177222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.177476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.177673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.177843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.177939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.178178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.178387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.178687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.178804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.178924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.179129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.179391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.179591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.179793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.179934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.180054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.180297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.180518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.180766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.180876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.180965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.181246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.181480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.181708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.181850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.181967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.182196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.182434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.182691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.182837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.182925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.183008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.183033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.183152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.183244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.557 [2024-10-16 07:25:59.183268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.557 qpair failed and we were unable to recover it. 00:27:56.557 [2024-10-16 07:25:59.183359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.183480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.183504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.183635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.183754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.183786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.183871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.184176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.184435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.184664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.184814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.184929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.185134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.185336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.185710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.185884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.186191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.186421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.186675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.186801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.186949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.187288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.187632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.187866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.187980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.188097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.188334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.188554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.188740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.188855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.189169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.189371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.189612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.189847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.189988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.190072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.190336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.190564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.190799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.190945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.558 qpair failed and we were unable to recover it. 00:27:56.558 [2024-10-16 07:25:59.191069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.191153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.558 [2024-10-16 07:25:59.191177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.191373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.191599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.191845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.191979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.192084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.192339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.192571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf27cb0 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.192825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.192990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.193131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.193373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.193612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.193844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.193990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.194092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.194333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.194577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.194820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.194938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.195035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.195287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.195517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.195754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.195868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.195971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.196251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.196455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.196661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.196814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.196904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.197020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.197050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.197145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.197236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.559 [2024-10-16 07:25:59.197262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.559 qpair failed and we were unable to recover it. 00:27:56.559 [2024-10-16 07:25:59.197385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.197581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.197797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.197909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.198042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.198253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.198457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.198721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.198852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.198942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.199178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.199389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.199625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.199844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.199982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.200080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.200287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.200501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.200743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.200854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.200948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.201240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.201503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.201755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.201876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.201974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.202212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.202442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.202673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.202839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.202937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.203133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.203332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.203581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.203796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.203909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.204031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.204136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.204162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.560 qpair failed and we were unable to recover it. 00:27:56.560 [2024-10-16 07:25:59.204254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.204348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.560 [2024-10-16 07:25:59.204374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.204468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.204589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.204613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.204697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.204797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.204823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.204914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.205149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.205395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.205635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.205848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.205960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.206065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.206298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.206489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.206756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.206869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.206958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.207224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.207461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.207662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.207788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.207890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.208140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.208346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.208573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.208815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.208938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.209056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.209299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.209502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.209770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.209891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.209981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.210190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.210438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.210645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.210798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.210923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.211010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.211035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.561 [2024-10-16 07:25:59.211131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.211222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.561 [2024-10-16 07:25:59.211248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.561 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.211363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.211608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.211846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.211961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.212059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.212336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.212537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.212775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.212923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.213016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.213258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.213514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.213709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.213849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.213930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.214124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.214324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.214559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.214772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.214893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.214997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.215235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.215475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.215702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.215858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.215956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.216175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.216425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.216633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.216887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.216998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.217084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.217290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.217546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.217801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.217939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.218032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.218116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.218141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.562 qpair failed and we were unable to recover it. 00:27:56.562 [2024-10-16 07:25:59.218245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.562 [2024-10-16 07:25:59.218371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.218395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.218514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.218598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.218624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.218748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.218834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.218858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.218959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.219194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.219409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.219614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.219853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.219998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.220103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.220323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.220527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.220764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.220872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.220972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.221182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.221408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.221603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.221841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.221952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.222065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.222280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.222524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.222762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.222878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.222973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.223193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.223460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.223666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.223872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.223983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.224081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.224170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.224194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.563 qpair failed and we were unable to recover it. 00:27:56.563 [2024-10-16 07:25:59.224310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.563 [2024-10-16 07:25:59.224398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.224424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.224546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.224630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.224654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.224755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.224837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.224861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.224954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.225175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.225444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.225648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.225857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.225970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.226087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.226319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.226525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.226776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.226949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.227076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.227285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.227486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.227682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.227807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.227921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.228170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.228373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.228607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.228815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.228933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.229061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.229299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.229498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.229748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.229870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.229955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.230159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.230372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.230600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.230855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.230959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.564 qpair failed and we were unable to recover it. 00:27:56.564 [2024-10-16 07:25:59.231082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.231167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.564 [2024-10-16 07:25:59.231192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.231275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.231502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.231702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.231832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.231957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.232175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.232413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.232619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.232831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.232940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.233035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.233234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.233467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.233663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.233904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.233989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.234096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.234308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.234510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.234747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.234859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.234948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.235173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.235380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.235618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.235900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.235990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.236139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.236351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.236548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.236753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.236891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.236990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.237201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.237408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.237632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.565 [2024-10-16 07:25:59.237772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.565 qpair failed and we were unable to recover it. 00:27:56.565 [2024-10-16 07:25:59.237865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.237961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.237985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.238113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.238314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.238555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.238803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.238925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.239023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.239225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.239439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.239671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.239881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.239998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.240141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.240377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.240589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.240796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.240909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.241029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.241263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.241471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.241698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.241822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.241910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.242299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.242523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.242770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.242909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.242999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.243212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.243411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.243674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.243891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.243981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.244007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 07:25:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:56.566 [2024-10-16 07:25:59.244101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.244193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 07:25:59 -- common/autotest_common.sh@852 -- # return 0 00:27:56.566 [2024-10-16 07:25:59.244217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 [2024-10-16 07:25:59.244301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 07:25:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:56.566 [2024-10-16 07:25:59.244383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.244407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.566 qpair failed and we were unable to recover it. 00:27:56.566 07:25:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:56.566 [2024-10-16 07:25:59.244511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.566 [2024-10-16 07:25:59.244627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.566 [2024-10-16 07:25:59.244652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.244743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.244835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.244862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.244963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.245204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.245405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.245608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.245816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.245971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.246065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.246265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.246456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.246715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.246833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.246924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.247127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.247327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.247533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.247783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.247898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.247995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.248257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.248488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.248712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.248847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.248941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.249140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.249343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.249546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.249799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.249911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.249999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.250222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.250465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.250669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.250879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.250974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.251000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.567 [2024-10-16 07:25:59.251119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.251208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.567 [2024-10-16 07:25:59.251235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.567 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.251356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.251559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.251796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.251910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.252008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.252204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.252472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.252723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.252858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.252947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.253153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.253388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.253624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.253831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.253947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.254035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.254287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.254505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.254701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.254818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.254923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.255123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.255318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.255572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.255778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.255894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.255985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.256231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.256463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.256715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.256838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.256928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.257054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.257078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.568 [2024-10-16 07:25:59.257228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.257319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.568 [2024-10-16 07:25:59.257343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.568 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.257465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.257674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.257871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.257981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.258077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.258322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.258519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.258717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.258841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.258937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.259175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.259413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.259648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.259865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.259979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.260067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.260335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.260531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.260772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.260882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.260972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.261207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.261447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.261683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.261807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.261921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.262182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.262442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.262666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.262904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.262998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.263106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.263298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.263533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.263753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.263875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.263978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.264072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.264098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.569 qpair failed and we were unable to recover it. 00:27:56.569 [2024-10-16 07:25:59.264183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.569 [2024-10-16 07:25:59.264298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.264438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.264678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.264884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.264994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.265128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.265352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.265588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.265832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.265948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.266048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 07:25:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:56.570 [2024-10-16 07:25:59.266285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 07:25:59 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:56.570 [2024-10-16 07:25:59.266496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.266694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.570 [2024-10-16 07:25:59.266799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.266827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.266915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.267127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.267388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.267590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.267833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.267953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.268040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.268269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.268471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.268666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.268829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.268953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.269160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.269445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.269639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.269859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.269973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.270057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.270296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.270490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.570 [2024-10-16 07:25:59.270681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.570 [2024-10-16 07:25:59.270794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.570 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.270916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.271149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.271361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.271581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.271874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.271989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.272091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.272291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.272498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.272739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.272894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.273014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.273302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.273586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.273793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.273907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.274016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.274245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.274477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.274710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.274833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.274925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.275202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.275445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.275649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.275793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.275885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.276171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.276372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.276601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.571 qpair failed and we were unable to recover it. 00:27:56.571 [2024-10-16 07:25:59.276841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.571 [2024-10-16 07:25:59.276953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.277044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.277265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.277480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.277680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.277831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.277918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.278188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.278387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.278606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.278826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.278950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.279058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.279302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.279505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.279745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.279904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.279996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.280252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.280447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.280654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.280805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.280931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.281135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.281377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.281606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.281847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.281965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.282054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.282157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.282187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.572 qpair failed and we were unable to recover it. 00:27:56.572 [2024-10-16 07:25:59.282278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.282368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.572 [2024-10-16 07:25:59.282394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.282497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.282580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.282605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.282687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.282779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.282804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.282919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.283168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.283380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.283660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.283870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.283994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.284113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.284402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.284633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.284849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.284959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.285085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.285289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.285518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.285722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.285881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.285977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.286386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.286592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.286823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.286934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.287021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.287298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.287535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.287786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.287903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.288025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.288230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.288433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.288696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.288818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.573 qpair failed and we were unable to recover it. 00:27:56.573 [2024-10-16 07:25:59.288939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.573 [2024-10-16 07:25:59.289024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.289163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.289374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.289611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.289833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.289979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.290104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.290337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.290564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.290783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.290899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.290984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.291201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.291573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.291819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.291934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.292047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.292295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.292565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.292813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.292922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.293009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 Malloc0 00:27:56.574 [2024-10-16 07:25:59.293254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.293484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.574 [2024-10-16 07:25:59.293699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 07:25:59 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:56.574 [2024-10-16 07:25:59.293852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.293881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.574 [2024-10-16 07:25:59.293980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.574 [2024-10-16 07:25:59.294077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.294222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.294438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.574 [2024-10-16 07:25:59.294708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.574 [2024-10-16 07:25:59.294844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.574 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.294962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.295173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.295464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.295686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.295873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.295963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.296207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.296457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.296664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.296832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.296849] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:56.575 [2024-10-16 07:25:59.296926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.297133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.297333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.297591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.297842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.297960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.298082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.298309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.298518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.298738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.298873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.298974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.299180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.299382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.299622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.299894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.299984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.300121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.300321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.300550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.300781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.300906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.301000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.301209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.301442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.575 [2024-10-16 07:25:59.301648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.575 [2024-10-16 07:25:59.301805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.575 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.301902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.301998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.302143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.302353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.302589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.302821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.302940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.303030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.303252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.303452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.303683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.303886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.303984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.304104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.304343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.304567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.304768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.304885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.304987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.576 [2024-10-16 07:25:59.305111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.305233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 07:25:59 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:56.576 [2024-10-16 07:25:59.305324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.576 [2024-10-16 07:25:59.305441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.576 [2024-10-16 07:25:59.305539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.305650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.305856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.305993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.306130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.306369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.306565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.576 qpair failed and we were unable to recover it. 00:27:56.576 [2024-10-16 07:25:59.306782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.576 [2024-10-16 07:25:59.306900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.306927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.307045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.307273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.307478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.307680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.307800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.307945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.308187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.308420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.308612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.308835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.308974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.309100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.309333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.309565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.309822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.309969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.310086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.310288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.310487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.310759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.310883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.310973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.311170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.311381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.311617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.311846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.311983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.312236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.312473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.312682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.577 qpair failed and we were unable to recover it. 00:27:56.577 [2024-10-16 07:25:59.312911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.577 [2024-10-16 07:25:59.312994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.578 [2024-10-16 07:25:59.313118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 07:25:59 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:56.578 [2024-10-16 07:25:59.313235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.313333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.578 [2024-10-16 07:25:59.313428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.578 [2024-10-16 07:25:59.313539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.313750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.313873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.313964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.314196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.314417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.314633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.314874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.314989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.315096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.315352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.315546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.315747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.315868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.315965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.316236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.316435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.316670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.316797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.316921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.317155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.317363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.317626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.317843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.317955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.318072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.318183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.318207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.318300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.318382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.578 [2024-10-16 07:25:59.318407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.578 qpair failed and we were unable to recover it. 00:27:56.578 [2024-10-16 07:25:59.318512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.318603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.318628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.318720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.318822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.318846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.318965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.319166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.319396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.319624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.319860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.319975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.320090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.320309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.320520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.320719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.320849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.320966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.579 [2024-10-16 07:25:59.321206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 07:25:59 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:56.579 [2024-10-16 07:25:59.321326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.579 [2024-10-16 07:25:59.321445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.579 [2024-10-16 07:25:59.321538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.321646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.321879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.321977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.322093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.322323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.322534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.322755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.322865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.322979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.323223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.323426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.323681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.323886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.323973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.324000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.324115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.324201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.324225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.324312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.324395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.579 [2024-10-16 07:25:59.324420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.579 qpair failed and we were unable to recover it. 00:27:56.579 [2024-10-16 07:25:59.324516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.580 [2024-10-16 07:25:59.324637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.580 [2024-10-16 07:25:59.324663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.324814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.580 [2024-10-16 07:25:59.324900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.580 [2024-10-16 07:25:59.324925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f47b4000b90 with addr=10.0.0.2, port=4420 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.325111] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:56.580 [2024-10-16 07:25:59.327578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.327703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.327754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.327773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.327792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.327837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.580 07:25:59 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:56.580 07:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:56.580 07:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:56.580 07:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:56.580 07:25:59 -- host/target_disconnect.sh@58 -- # wait 2024677 00:27:56.580 [2024-10-16 07:25:59.337519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.337639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.337666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.337680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.337693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.337723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.347425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.347519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.347546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.347561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.347574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.347604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.357515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.357616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.357643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.357657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.357670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.357700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.367395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.367490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.367516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.367530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.367549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.367582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.377459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.377548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.377575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.377589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.377602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.377632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.387449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.387538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.387565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.387579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.387592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.387622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.397452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.397545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.397571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.397585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.397598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.397628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.407514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.407646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.407672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.407687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.407700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.407738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.417518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.417615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.417644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.417659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.417672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.417702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.427604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.427691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.427718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.427743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.427758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.427788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.437673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.437777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.580 [2024-10-16 07:25:59.437803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.580 [2024-10-16 07:25:59.437817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.580 [2024-10-16 07:25:59.437830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.580 [2024-10-16 07:25:59.437860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.580 qpair failed and we were unable to recover it. 00:27:56.580 [2024-10-16 07:25:59.447602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.580 [2024-10-16 07:25:59.447700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.581 [2024-10-16 07:25:59.447726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.581 [2024-10-16 07:25:59.447752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.581 [2024-10-16 07:25:59.447765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.581 [2024-10-16 07:25:59.447795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.581 qpair failed and we were unable to recover it. 00:27:56.581 [2024-10-16 07:25:59.457648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.581 [2024-10-16 07:25:59.457754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.581 [2024-10-16 07:25:59.457780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.581 [2024-10-16 07:25:59.457803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.581 [2024-10-16 07:25:59.457816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.581 [2024-10-16 07:25:59.457846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.581 qpair failed and we were unable to recover it. 00:27:56.581 [2024-10-16 07:25:59.467690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.581 [2024-10-16 07:25:59.467806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.581 [2024-10-16 07:25:59.467831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.581 [2024-10-16 07:25:59.467846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.581 [2024-10-16 07:25:59.467859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.581 [2024-10-16 07:25:59.467889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.581 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.477758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.477853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.477878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.477892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.477905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.477937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.487826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.487940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.487966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.487981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.487993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.488022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.497891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.497985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.498014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.498029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.498042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.498072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.507816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.507928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.507953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.507967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.507980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.508010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.517863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.517959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.517984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.517999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.518012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.518043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.527841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.527929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.527954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.527968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.527981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.528012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.537890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.537983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.538009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.538024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.538037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.538068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.547899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.547989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.548015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.548036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.548050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.548080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.557958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.558051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.558076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.558089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.558104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.558134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.567956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.568053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.568079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.840 [2024-10-16 07:25:59.568093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.840 [2024-10-16 07:25:59.568106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.840 [2024-10-16 07:25:59.568137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.840 qpair failed and we were unable to recover it. 00:27:56.840 [2024-10-16 07:25:59.577981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.840 [2024-10-16 07:25:59.578068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.840 [2024-10-16 07:25:59.578094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.578108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.578121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.578152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.588040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.588173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.588198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.588212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.588225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.588256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.598049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.598150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.598176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.598190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.598203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.598234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.608068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.608172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.608197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.608211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.608224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.608256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.618182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.618277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.618303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.618317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.618330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.618359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.628134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.628223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.628249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.628263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.628276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.628307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.638164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.638257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.638287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.638302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.638315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.638346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.648288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.648385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.648410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.648425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.648438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.648468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.658220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.658312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.658339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.658353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.658367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.658398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.668231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.668316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.668342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.668356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.668369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.668401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.678390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.678487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.678513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.678528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.678541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.678578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.688289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.688378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.688404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.688418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.688431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.688463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.698336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.698439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.698464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.698478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.698491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.698521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.708367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.708462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.708488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.708502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.708515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.841 [2024-10-16 07:25:59.708546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.841 qpair failed and we were unable to recover it. 00:27:56.841 [2024-10-16 07:25:59.718505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.841 [2024-10-16 07:25:59.718617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.841 [2024-10-16 07:25:59.718643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.841 [2024-10-16 07:25:59.718657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.841 [2024-10-16 07:25:59.718669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.718699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.728516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.728610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.728642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.728657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.728670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.728701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.738527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.738617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.738643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.738658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.738672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.738701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.748480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.748570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.748597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.748612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.748625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.748655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.758512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.758608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.758634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.758649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.758662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.758693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.768529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.768653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.768680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.768694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.768707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.768765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:56.842 [2024-10-16 07:25:59.778551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.842 [2024-10-16 07:25:59.778685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.842 [2024-10-16 07:25:59.778711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.842 [2024-10-16 07:25:59.778726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.842 [2024-10-16 07:25:59.778752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:56.842 [2024-10-16 07:25:59.778782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:56.842 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.788656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.788755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.788781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.788795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.788809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.788839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.798614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.798737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.798771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.798786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.798798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.798830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.808643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.808771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.808797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.808811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.808824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.808854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.818672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.818767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.818798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.818814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.818827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.818856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.828697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.828791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.828817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.828832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.828845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.828874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.838748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.838850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.838879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.838894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.838907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.838937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.848791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.848882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.848908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.848923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.848936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.848966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.858795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.858880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.858906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.858921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.858939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.858971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.868911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.869014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.869040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.869054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.869067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.869096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.878864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.878987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.879013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.879027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.879041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.879071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.888864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.888951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.888977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.888991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.889004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.889033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.898923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.899014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.899040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.899054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.101 [2024-10-16 07:25:59.899067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.101 [2024-10-16 07:25:59.899098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.101 qpair failed and we were unable to recover it. 00:27:57.101 [2024-10-16 07:25:59.909009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.101 [2024-10-16 07:25:59.909105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.101 [2024-10-16 07:25:59.909130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.101 [2024-10-16 07:25:59.909145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.909158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.909188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.918962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.919058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.919083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.919100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.919113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.919143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.929014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.929103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.929129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.929143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.929156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.929186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.939107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.939202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.939231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.939247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.939260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.939290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.949036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.949132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.949161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.949176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.949194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.949225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.959079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.959179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.959204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.959219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.959232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.959262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.969100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.969198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.969227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.969242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.969256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.969286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.979124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.979212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.979237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.979252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.979264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.979294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.989174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.989271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.989298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.989312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.989325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.989354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:25:59.999179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:25:59.999303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:25:59.999329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:25:59.999344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:25:59.999357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:25:59.999386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:26:00.009222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:26:00.009323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:26:00.009350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:26:00.009365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:26:00.009378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:26:00.009409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:26:00.019252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:26:00.019351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:26:00.019380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:26:00.019395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:26:00.019408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:26:00.019439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:26:00.029282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:26:00.029413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:26:00.029440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:26:00.029455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:26:00.029468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:26:00.029498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.102 [2024-10-16 07:26:00.039399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.102 [2024-10-16 07:26:00.039497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.102 [2024-10-16 07:26:00.039524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.102 [2024-10-16 07:26:00.039546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.102 [2024-10-16 07:26:00.039560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.102 [2024-10-16 07:26:00.039593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.102 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.049337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.049437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.049464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.049479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.049492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.049524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.059384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.059502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.059529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.059544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.059557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.059588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.069418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.069512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.069538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.069552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.069566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.069595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.079450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.079546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.079572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.079586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.079598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.079628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.089455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.089549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.089575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.089589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.089603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.089632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.099477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.099574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.099600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.099615] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.099628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.099658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.109570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.109666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.109695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.109714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.109735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.109785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.119544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.119640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.119666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.119681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.119694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.119724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.129592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.362 [2024-10-16 07:26:00.129681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.362 [2024-10-16 07:26:00.129712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.362 [2024-10-16 07:26:00.129734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.362 [2024-10-16 07:26:00.129750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.362 [2024-10-16 07:26:00.129780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.362 qpair failed and we were unable to recover it. 00:27:57.362 [2024-10-16 07:26:00.139605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.139698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.139724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.139750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.139764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.139795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.149617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.149704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.149738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.149755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.149769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.149798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.159678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.159827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.159856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.159872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.159886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.159916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.169780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.169875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.169902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.169917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.169930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.169966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.179710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.179810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.179836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.179852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.179865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.179895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.189800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.189887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.189914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.189928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.189941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.189973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.199786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.199914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.199940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.199955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.199968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.199999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.209816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.209915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.209940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.209954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.209967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.209998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.219909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.220024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.220059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.220075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.220089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.220119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.229873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.229960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.229986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.230000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.230013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.230043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.239996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.240091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.240117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.240131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.240145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.240174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.249928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.250028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.250053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.250067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.250080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.250110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.363 [2024-10-16 07:26:00.259954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.363 [2024-10-16 07:26:00.260040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.363 [2024-10-16 07:26:00.260066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.363 [2024-10-16 07:26:00.260080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.363 [2024-10-16 07:26:00.260094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.363 [2024-10-16 07:26:00.260132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.363 qpair failed and we were unable to recover it. 00:27:57.364 [2024-10-16 07:26:00.270022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.364 [2024-10-16 07:26:00.270123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.364 [2024-10-16 07:26:00.270148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.364 [2024-10-16 07:26:00.270163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.364 [2024-10-16 07:26:00.270176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.364 [2024-10-16 07:26:00.270206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.364 qpair failed and we were unable to recover it. 00:27:57.364 [2024-10-16 07:26:00.280026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.364 [2024-10-16 07:26:00.280127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.364 [2024-10-16 07:26:00.280153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.364 [2024-10-16 07:26:00.280168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.364 [2024-10-16 07:26:00.280181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.364 [2024-10-16 07:26:00.280210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.364 qpair failed and we were unable to recover it. 00:27:57.364 [2024-10-16 07:26:00.290040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.364 [2024-10-16 07:26:00.290160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.364 [2024-10-16 07:26:00.290186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.364 [2024-10-16 07:26:00.290200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.364 [2024-10-16 07:26:00.290213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.364 [2024-10-16 07:26:00.290243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.364 qpair failed and we were unable to recover it. 00:27:57.364 [2024-10-16 07:26:00.300079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.364 [2024-10-16 07:26:00.300170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.364 [2024-10-16 07:26:00.300194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.364 [2024-10-16 07:26:00.300208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.364 [2024-10-16 07:26:00.300220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.364 [2024-10-16 07:26:00.300249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.364 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.310113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.310203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.310235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.310250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.310263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.310293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.320172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.320284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.320310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.320324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.320337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.320367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.330145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.330246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.330272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.330286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.330299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.330330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.340262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.340369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.340435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.340452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.340466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.340510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.350244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.350347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.350374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.350389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.350408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.350440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.360319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.360421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.360447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.360462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.360475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.360505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.370298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.623 [2024-10-16 07:26:00.370398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.623 [2024-10-16 07:26:00.370424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.623 [2024-10-16 07:26:00.370438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.623 [2024-10-16 07:26:00.370451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.623 [2024-10-16 07:26:00.370481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.623 qpair failed and we were unable to recover it. 00:27:57.623 [2024-10-16 07:26:00.380427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.380543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.380568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.380582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.380596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.380627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.390342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.390431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.390457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.390471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.390484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.390521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.400463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.400562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.400588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.400603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.400617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.400649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.410376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.410472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.410499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.410514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.410527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.410557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.420441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.420529] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.420554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.420568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.420582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.420612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.430426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.430514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.430540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.430554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.430568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.430598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.440466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.440579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.440605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.440620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.440639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.440671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.450538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.450630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.450656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.450671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.450684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.450715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.460535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.460628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.460654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.460669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.460682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.460712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.470553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.470643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.470669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.470684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.470697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.470734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.480610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.480704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.480736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.480753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.480766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.480796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.490626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.490720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.490755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.490770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.624 [2024-10-16 07:26:00.490783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.624 [2024-10-16 07:26:00.490814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.624 qpair failed and we were unable to recover it. 00:27:57.624 [2024-10-16 07:26:00.500646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.624 [2024-10-16 07:26:00.500742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.624 [2024-10-16 07:26:00.500768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.624 [2024-10-16 07:26:00.500782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.500795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.500825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.510736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.510828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.510854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.510868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.510881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.510912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.520757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.520911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.520936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.520951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.520964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.520994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.530790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.530888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.530913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.530933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.530947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.530978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.540785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.540907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.540937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.540953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.540966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.540997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.550794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.550889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.550915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.550930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.550943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.550973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.625 [2024-10-16 07:26:00.560960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.625 [2024-10-16 07:26:00.561055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.625 [2024-10-16 07:26:00.561081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.625 [2024-10-16 07:26:00.561095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.625 [2024-10-16 07:26:00.561108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.625 [2024-10-16 07:26:00.561138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.625 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.570859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.570954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.570979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.570994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.571007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.571036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.580878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.580971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.580997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.581011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.581025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.581056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.590984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.591071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.591097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.591111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.591124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.591155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.600967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.601064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.601089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.601104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.601117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.601148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.610993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.611087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.611112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.611126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.611140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.611170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.620994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.621092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.621121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.621142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.621156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.621186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.631028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.631125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.631151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.631165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.631178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.631209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.641133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.641231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.641256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.641270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.641286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.641316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.651075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.651163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.651189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.651204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.651217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.651247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.661206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.661344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.661369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.661384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.661397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.661428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.671184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.885 [2024-10-16 07:26:00.671278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.885 [2024-10-16 07:26:00.671304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.885 [2024-10-16 07:26:00.671324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.885 [2024-10-16 07:26:00.671339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.885 [2024-10-16 07:26:00.671369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.885 qpair failed and we were unable to recover it. 00:27:57.885 [2024-10-16 07:26:00.681160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.681253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.681278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.681293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.681306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.681336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.691191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.691283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.691309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.691323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.691336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.691380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.701215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.701305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.701331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.701345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.701358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.701389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.711281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.711380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.711410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.711425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.711438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.711469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.721306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.721410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.721436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.721450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.721463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.721493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.731355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.731483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.731508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.731522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.731535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.731566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.741403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.741542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.741567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.741581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.741594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.741624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.751444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.751533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.751559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.751574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.751589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.751627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.761416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.761516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.761542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.761556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.761569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.761599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.771468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.771569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.771595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.771609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.771623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.771653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.781434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.781523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.781549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.781563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.781575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.781605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.791473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.791562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.791588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.791603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.791616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.791646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.801542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.801688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.801723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.801751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.801765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.801805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.811530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.886 [2024-10-16 07:26:00.811676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.886 [2024-10-16 07:26:00.811702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.886 [2024-10-16 07:26:00.811717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.886 [2024-10-16 07:26:00.811738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.886 [2024-10-16 07:26:00.811772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.886 qpair failed and we were unable to recover it. 00:27:57.886 [2024-10-16 07:26:00.821559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.887 [2024-10-16 07:26:00.821651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.887 [2024-10-16 07:26:00.821676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.887 [2024-10-16 07:26:00.821691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.887 [2024-10-16 07:26:00.821704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:57.887 [2024-10-16 07:26:00.821742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:57.887 qpair failed and we were unable to recover it. 00:27:58.145 [2024-10-16 07:26:00.831574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.145 [2024-10-16 07:26:00.831665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.145 [2024-10-16 07:26:00.831691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.145 [2024-10-16 07:26:00.831705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.145 [2024-10-16 07:26:00.831719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.145 [2024-10-16 07:26:00.831758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.145 qpair failed and we were unable to recover it. 00:27:58.145 [2024-10-16 07:26:00.841647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.145 [2024-10-16 07:26:00.841752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.145 [2024-10-16 07:26:00.841778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.145 [2024-10-16 07:26:00.841793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.145 [2024-10-16 07:26:00.841811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.145 [2024-10-16 07:26:00.841844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.145 qpair failed and we were unable to recover it. 00:27:58.145 [2024-10-16 07:26:00.851739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.145 [2024-10-16 07:26:00.851868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.145 [2024-10-16 07:26:00.851895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.145 [2024-10-16 07:26:00.851909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.145 [2024-10-16 07:26:00.851922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.851952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.861672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.861806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.861832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.861847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.861860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.861890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.871706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.871811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.871837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.871851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.871864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.871896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.881742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.881838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.881864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.881878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.881891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.881922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.891881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.892012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.892038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.892052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.892066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.892097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.901820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.901922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.901948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.901963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.901976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.902005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.911882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.911981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.912007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.912022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.912035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.912065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.921918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.922013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.922039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.922053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.922067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.922097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.931884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.931976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.932002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.932017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.932036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.932067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.941935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.942023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.942050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.942064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.942078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.942109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.951969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.952082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.952107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.952122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.952135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.952165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.961999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.962091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.962116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.962131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.962144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.962173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.146 [2024-10-16 07:26:00.972013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.146 [2024-10-16 07:26:00.972108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.146 [2024-10-16 07:26:00.972134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.146 [2024-10-16 07:26:00.972148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.146 [2024-10-16 07:26:00.972161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.146 [2024-10-16 07:26:00.972190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.146 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:00.982095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:00.982213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:00.982239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:00.982253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:00.982267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:00.982297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:00.992069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:00.992156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:00.992182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:00.992196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:00.992209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:00.992238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.002198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.002321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.002348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.002364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.002377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.002410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.012109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.012209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.012235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.012250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.012263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.012293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.022187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.022270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.022296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.022317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.022331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.022361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.032246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.032341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.032370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.032385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.032399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.032428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.042229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.042339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.042364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.042378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.042391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.042420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.052234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.052325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.052350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.052364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.052378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.052408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.062288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.062383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.062409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.062424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.062437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.062468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.072329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.072421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.072447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.072461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.072474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.072504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.147 [2024-10-16 07:26:01.082330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.147 [2024-10-16 07:26:01.082421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.147 [2024-10-16 07:26:01.082446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.147 [2024-10-16 07:26:01.082460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.147 [2024-10-16 07:26:01.082473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.147 [2024-10-16 07:26:01.082503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.147 qpair failed and we were unable to recover it. 00:27:58.406 [2024-10-16 07:26:01.092348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.406 [2024-10-16 07:26:01.092493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.406 [2024-10-16 07:26:01.092518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.406 [2024-10-16 07:26:01.092532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.406 [2024-10-16 07:26:01.092546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.406 [2024-10-16 07:26:01.092575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.406 qpair failed and we were unable to recover it. 00:27:58.406 [2024-10-16 07:26:01.102396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.406 [2024-10-16 07:26:01.102514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.406 [2024-10-16 07:26:01.102540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.406 [2024-10-16 07:26:01.102554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.406 [2024-10-16 07:26:01.102566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.406 [2024-10-16 07:26:01.102597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.406 qpair failed and we were unable to recover it. 00:27:58.406 [2024-10-16 07:26:01.112402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.406 [2024-10-16 07:26:01.112498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.406 [2024-10-16 07:26:01.112524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.406 [2024-10-16 07:26:01.112545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.406 [2024-10-16 07:26:01.112559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.406 [2024-10-16 07:26:01.112589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.406 qpair failed and we were unable to recover it. 00:27:58.406 [2024-10-16 07:26:01.122461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.406 [2024-10-16 07:26:01.122560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.406 [2024-10-16 07:26:01.122585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.406 [2024-10-16 07:26:01.122600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.406 [2024-10-16 07:26:01.122613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.406 [2024-10-16 07:26:01.122642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.406 qpair failed and we were unable to recover it. 00:27:58.406 [2024-10-16 07:26:01.132591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.406 [2024-10-16 07:26:01.132686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.406 [2024-10-16 07:26:01.132712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.406 [2024-10-16 07:26:01.132734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.132750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.132783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.142547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.142652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.142678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.142692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.142705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.142742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.152550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.152642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.152668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.152682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.152694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.152725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.162589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.162688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.162714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.162735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.162751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.162780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.172624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.172754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.172780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.172795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.172808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.172839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.182641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.182751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.182779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.182794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.182807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.182837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.192679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.192788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.192815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.192829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.192843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.192873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.202678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.202782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.202813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.202829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.202842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.202874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.212720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.212822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.212848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.212862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.212876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.212920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.222776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.222866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.222892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.222906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.222919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.222950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.232807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.232924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.232950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.232964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.232977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.233007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.242829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.242921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.242948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.242962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.242975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.243025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.252826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.252917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.252943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.252958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.252970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.252999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.262877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.262964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.262989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.263004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.407 [2024-10-16 07:26:01.263017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.407 [2024-10-16 07:26:01.263048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.407 qpair failed and we were unable to recover it. 00:27:58.407 [2024-10-16 07:26:01.272953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.407 [2024-10-16 07:26:01.273069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.407 [2024-10-16 07:26:01.273095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.407 [2024-10-16 07:26:01.273109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.273122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.273152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.282904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.282999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.283024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.283039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.283052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.283081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.292929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.293041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.293072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.293087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.293100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.293130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.303096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.303228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.303252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.303266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.303278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.303307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.313080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.313178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.313203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.313217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.313231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.313260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.323036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.323149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.323175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.323189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.323203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.323233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.333135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.333237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.333263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.333278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.333292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.333328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.408 [2024-10-16 07:26:01.343086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.408 [2024-10-16 07:26:01.343181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.408 [2024-10-16 07:26:01.343207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.408 [2024-10-16 07:26:01.343222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.408 [2024-10-16 07:26:01.343235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.408 [2024-10-16 07:26:01.343264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.408 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.353098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.353226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.353252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.353265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.353278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.353307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.363130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.363228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.363253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.363268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.363281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.363311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.373170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.373264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.373290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.373305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.373318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.373348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.383248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.383340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.383372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.383387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.383400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.383431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.393206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.393342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.393368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.393383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.393396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.393426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.403285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.403383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.403409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.403423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.403436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.403466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.413324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.413424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.413451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.413471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.413485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.413516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.423309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.423396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.423422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.423436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.423457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.423488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.433439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.433532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.433558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.433573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.433586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.433616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.443359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.443453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.443479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.443493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.443506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.443536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.667 qpair failed and we were unable to recover it. 00:27:58.667 [2024-10-16 07:26:01.453484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.667 [2024-10-16 07:26:01.453570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.667 [2024-10-16 07:26:01.453595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.667 [2024-10-16 07:26:01.453609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.667 [2024-10-16 07:26:01.453622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.667 [2024-10-16 07:26:01.453652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.463521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.463637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.463662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.463677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.463690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.463719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.473470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.473562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.473587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.473601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.473614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.473646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.483475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.483573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.483599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.483614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.483627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.483657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.493610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.493750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.493777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.493792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.493805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.493835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.503666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.503762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.503789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.503803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.503817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.503848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.513623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.513713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.513747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.513768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.513782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.513813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.523648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.523753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.523787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.523801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.523814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.523846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.533631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.533764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.533790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.533804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.533817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.533848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.543666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.543767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.543796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.543810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.543824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.543854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.553685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.553782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.553808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.553823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.553836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.553865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.563811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.563906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.563932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.563946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.563959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.563989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.573844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.573939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.573966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.573981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.573994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.574025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.583833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.583949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.583975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.668 [2024-10-16 07:26:01.583989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.668 [2024-10-16 07:26:01.584003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.668 [2024-10-16 07:26:01.584032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.668 qpair failed and we were unable to recover it. 00:27:58.668 [2024-10-16 07:26:01.593824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.668 [2024-10-16 07:26:01.593918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.668 [2024-10-16 07:26:01.593944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.669 [2024-10-16 07:26:01.593959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.669 [2024-10-16 07:26:01.593972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.669 [2024-10-16 07:26:01.594001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.669 qpair failed and we were unable to recover it. 00:27:58.669 [2024-10-16 07:26:01.603875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.669 [2024-10-16 07:26:01.603986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.669 [2024-10-16 07:26:01.604015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.669 [2024-10-16 07:26:01.604037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.669 [2024-10-16 07:26:01.604051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.669 [2024-10-16 07:26:01.604081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.669 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.613914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.614037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.614062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.614076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.614089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.614119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.623985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.624081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.624108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.624123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.624136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.624170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.634017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.634108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.634134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.634149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.634162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.634191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.644053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.644143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.644170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.644184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.644198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.644229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.654004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.654092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.654118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.654132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.654146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.654176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.664002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.664101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.664126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.664141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.664154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.664184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.674020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.674114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.674140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.674154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.674167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.674197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.684154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.684249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.684275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.684289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.684302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.684331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.694086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.694185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.694217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.694233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.694247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.694276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.704151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.704246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.704275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.704290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.704303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.704335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.714279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.714414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.714439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.714453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.714466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.714496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.724263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.724366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.724391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.724406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.724419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.724449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.734237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.734325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.928 [2024-10-16 07:26:01.734351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.928 [2024-10-16 07:26:01.734365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.928 [2024-10-16 07:26:01.734378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.928 [2024-10-16 07:26:01.734414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.928 qpair failed and we were unable to recover it. 00:27:58.928 [2024-10-16 07:26:01.744252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.928 [2024-10-16 07:26:01.744348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.744374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.744389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.744402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.744432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.754335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.754433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.754459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.754476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.754489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.754532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.764442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.764570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.764595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.764610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.764623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.764653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.774371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.774461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.774487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.774502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.774515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.774545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.784366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.784472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.784503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.784518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.784532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.784561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.794417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.794503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.794529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.794543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.794557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.794588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.804471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.804577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.804606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.804621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.804634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.804665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.814486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.814583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.814609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.814624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.814637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.814668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.824514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.824624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.824650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.824665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.824678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.824714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.834511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.834618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.834644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.834658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.834672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.834716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.844604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.844703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.844738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.844756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.844770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.844801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.854580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.854694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.854720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.854743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.854759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.854790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:58.929 [2024-10-16 07:26:01.864592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.929 [2024-10-16 07:26:01.864691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.929 [2024-10-16 07:26:01.864717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.929 [2024-10-16 07:26:01.864744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.929 [2024-10-16 07:26:01.864761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:58.929 [2024-10-16 07:26:01.864791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:58.929 qpair failed and we were unable to recover it. 00:27:59.188 [2024-10-16 07:26:01.874671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.188 [2024-10-16 07:26:01.874778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.188 [2024-10-16 07:26:01.874809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.188 [2024-10-16 07:26:01.874824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.188 [2024-10-16 07:26:01.874837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.188 [2024-10-16 07:26:01.874868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.188 qpair failed and we were unable to recover it. 00:27:59.188 [2024-10-16 07:26:01.884706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.188 [2024-10-16 07:26:01.884817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.188 [2024-10-16 07:26:01.884843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.188 [2024-10-16 07:26:01.884857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.188 [2024-10-16 07:26:01.884870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.188 [2024-10-16 07:26:01.884900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.188 qpair failed and we were unable to recover it. 00:27:59.188 [2024-10-16 07:26:01.894705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.188 [2024-10-16 07:26:01.894828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.188 [2024-10-16 07:26:01.894854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.188 [2024-10-16 07:26:01.894868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.188 [2024-10-16 07:26:01.894881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.188 [2024-10-16 07:26:01.894911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.188 qpair failed and we were unable to recover it. 00:27:59.188 [2024-10-16 07:26:01.904773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.188 [2024-10-16 07:26:01.904913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.188 [2024-10-16 07:26:01.904942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.188 [2024-10-16 07:26:01.904957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.188 [2024-10-16 07:26:01.904970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.188 [2024-10-16 07:26:01.905000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.188 qpair failed and we were unable to recover it. 00:27:59.188 [2024-10-16 07:26:01.914789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.188 [2024-10-16 07:26:01.914901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.188 [2024-10-16 07:26:01.914930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.188 [2024-10-16 07:26:01.914945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.188 [2024-10-16 07:26:01.914964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.914994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.924804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.924898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.924924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.924938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.924951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.924981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.934830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.934951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.934977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.934991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.935004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.935035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.944845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.944927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.944953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.944967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.944981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.945012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.954858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.954952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.954978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.954992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.955006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.955035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.964956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.965094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.965119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.965134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.965147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.965176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.974972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.975104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.975133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.975148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.975161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.975192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.984972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.985071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.985097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.985111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.985125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.985155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:01.995001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:01.995103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:01.995129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:01.995144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:01.995157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:01.995187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:02.005034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:02.005132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:02.005162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:02.005177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:02.005196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:02.005229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:02.015074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:02.015179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:02.015206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:02.015220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:02.015233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:02.015263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:02.025066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:02.025155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:02.025181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:02.025195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:02.025208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:02.025238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:02.035083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:02.035205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:02.035231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:02.035245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:02.035259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:02.035288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.189 [2024-10-16 07:26:02.045207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.189 [2024-10-16 07:26:02.045320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.189 [2024-10-16 07:26:02.045349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.189 [2024-10-16 07:26:02.045365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.189 [2024-10-16 07:26:02.045379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.189 [2024-10-16 07:26:02.045409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.189 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.055183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.055303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.055329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.055344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.055358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.055388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.065236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.065367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.065395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.065411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.065424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.065454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.075220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.075306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.075332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.075347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.075360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.075389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.085256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.085350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.085375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.085390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.085403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.085432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.095329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.095442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.095468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.095489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.095503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.095533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.105345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.105441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.105466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.105481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.105494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.105524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.115607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.115763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.115789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.115803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.115817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.115847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.190 [2024-10-16 07:26:02.125390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.190 [2024-10-16 07:26:02.125515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.190 [2024-10-16 07:26:02.125540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.190 [2024-10-16 07:26:02.125555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.190 [2024-10-16 07:26:02.125569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.190 [2024-10-16 07:26:02.125598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.190 qpair failed and we were unable to recover it. 00:27:59.448 [2024-10-16 07:26:02.135401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.448 [2024-10-16 07:26:02.135530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.448 [2024-10-16 07:26:02.135556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.448 [2024-10-16 07:26:02.135571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.448 [2024-10-16 07:26:02.135584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.448 [2024-10-16 07:26:02.135614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.448 qpair failed and we were unable to recover it. 00:27:59.448 [2024-10-16 07:26:02.145423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.448 [2024-10-16 07:26:02.145521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.448 [2024-10-16 07:26:02.145547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.448 [2024-10-16 07:26:02.145561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.448 [2024-10-16 07:26:02.145574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.145605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.155538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.155666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.155693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.155708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.155721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.155765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.165484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.165601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.165627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.165641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.165654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.165685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.175490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.175577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.175602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.175617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.175630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.175660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.185541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.185629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.185655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.185678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.185693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.185723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.195600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.195696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.195722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.195745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.195759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.195789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.205606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.205704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.205741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.205761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.205774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.205805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.215615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.215711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.215746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.215762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.215775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.215805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.225674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.225778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.225805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.225819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.225832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.225862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.235679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.235780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.235806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.235821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.235834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.235865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.245711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.245821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.245849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.245867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.245881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.245913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.255716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.255844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.255871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.255886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.255898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.255927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.265787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.265877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.265903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.265917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.265931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.265962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.275779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.275919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.275949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.275964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.275978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.449 [2024-10-16 07:26:02.276008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.449 qpair failed and we were unable to recover it. 00:27:59.449 [2024-10-16 07:26:02.285850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.449 [2024-10-16 07:26:02.285947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.449 [2024-10-16 07:26:02.285976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.449 [2024-10-16 07:26:02.285993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.449 [2024-10-16 07:26:02.286007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.286037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.295834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.295924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.295949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.295964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.295977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.296009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.305874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.305968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.305992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.306006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.306018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.306047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.315904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.315997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.316023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.316037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.316051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.316088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.325948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.326053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.326079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.326093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.326107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.326137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.335969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.336058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.336084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.336098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.336111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.336140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.346017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.346106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.346131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.346146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.346159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.346188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.356039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.356160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.356186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.356201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.356214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.356245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.366041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.366131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.366161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.366176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.366189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.366218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.376103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.376217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.376242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.376257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.376271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.376301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.450 [2024-10-16 07:26:02.386114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.450 [2024-10-16 07:26:02.386208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.450 [2024-10-16 07:26:02.386235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.450 [2024-10-16 07:26:02.386250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.450 [2024-10-16 07:26:02.386263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.450 [2024-10-16 07:26:02.386305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.450 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.396150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.396243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.396269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.396283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.396297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.396326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.406207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.406311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.406337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.406352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.406372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.406403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.416266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.416364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.416390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.416404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.416417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.416448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.426257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.426350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.426376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.426391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.426404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.426433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.436226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.436327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.436353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.436367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.436380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.436410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.446303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.446399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.446424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.446439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.446452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.446482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.456391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.456489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.709 [2024-10-16 07:26:02.456514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.709 [2024-10-16 07:26:02.456529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.709 [2024-10-16 07:26:02.456542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.709 [2024-10-16 07:26:02.456573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.709 qpair failed and we were unable to recover it. 00:27:59.709 [2024-10-16 07:26:02.466335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.709 [2024-10-16 07:26:02.466418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.466444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.466458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.466471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.466502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.476363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.476450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.476475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.476490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.476504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.476533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.486393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.486488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.486514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.486528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.486541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.486573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.496452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.496553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.496579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.496593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.496612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.496643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.506436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.506533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.506558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.506573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.506587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.506616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.516482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.516569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.516594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.516609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.516622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.516651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.526527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.526649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.526678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.526693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.526706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.526746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.536594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.536695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.536721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.536745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.536759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.536790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.546592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.546683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.546709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.546724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.546749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.546781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.556594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.556682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.556709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.556723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.556745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.556775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.566607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.566706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.566751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.566767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.566780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.566810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.576647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.576777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.576806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.576822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.576835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.576866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.586667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.586770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.586797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.586818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.586832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.586863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.596685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.596782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.710 [2024-10-16 07:26:02.596809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.710 [2024-10-16 07:26:02.596824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.710 [2024-10-16 07:26:02.596836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.710 [2024-10-16 07:26:02.596866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.710 qpair failed and we were unable to recover it. 00:27:59.710 [2024-10-16 07:26:02.606747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.710 [2024-10-16 07:26:02.606891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.711 [2024-10-16 07:26:02.606917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.711 [2024-10-16 07:26:02.606932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.711 [2024-10-16 07:26:02.606945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.711 [2024-10-16 07:26:02.606974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-10-16 07:26:02.616808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.711 [2024-10-16 07:26:02.616908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.711 [2024-10-16 07:26:02.616934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.711 [2024-10-16 07:26:02.616949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.711 [2024-10-16 07:26:02.616962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.711 [2024-10-16 07:26:02.616994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-10-16 07:26:02.626830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.711 [2024-10-16 07:26:02.626929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.711 [2024-10-16 07:26:02.626954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.711 [2024-10-16 07:26:02.626968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.711 [2024-10-16 07:26:02.626981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.711 [2024-10-16 07:26:02.627011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-10-16 07:26:02.636848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.711 [2024-10-16 07:26:02.636941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.711 [2024-10-16 07:26:02.636968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.711 [2024-10-16 07:26:02.636982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.711 [2024-10-16 07:26:02.636995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.711 [2024-10-16 07:26:02.637026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.711 [2024-10-16 07:26:02.646942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.711 [2024-10-16 07:26:02.647039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.711 [2024-10-16 07:26:02.647065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.711 [2024-10-16 07:26:02.647082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.711 [2024-10-16 07:26:02.647095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.711 [2024-10-16 07:26:02.647125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.711 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.656877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.656968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.656993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.657007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.657020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.657050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.667018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.667109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.667139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.667154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.667167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.667197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.676961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.677053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.677079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.677101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.677114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.677145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.687016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.687137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.687163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.687177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.687190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.687219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.696994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.697086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.697111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.697126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.697139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.697169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.707065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.707153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.707180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.707195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.707208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.707251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.717080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.717213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.717239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.717253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.717266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.717295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.727088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.727190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.727218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.727233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.727247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.727276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.737105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.737196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.737221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.737236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.737249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.737279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.747172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.970 [2024-10-16 07:26:02.747263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.970 [2024-10-16 07:26:02.747289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.970 [2024-10-16 07:26:02.747303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.970 [2024-10-16 07:26:02.747316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.970 [2024-10-16 07:26:02.747346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.970 qpair failed and we were unable to recover it. 00:27:59.970 [2024-10-16 07:26:02.757226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.757316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.757342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.757356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.757369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.757398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.767270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.767369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.767400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.767415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.767428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.767457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.777320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.777439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.777465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.777479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.777494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.777523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.787275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.787402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.787429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.787443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.787455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.787485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.797380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.797481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.797507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.797521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.797535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.797565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.807350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.807445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.807471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.807485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.807498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.807534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.817374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.817484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.817509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.817524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.817537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.817566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.827398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.827488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.827514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.827528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.827541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.827571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.837419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.837511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.837537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.837551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.837565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.837594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.847444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.847560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.847586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.847600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.847613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.847643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.857479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.857585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.857620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.857636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.857650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.857680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.867503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.867595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.867621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.867636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.867649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.867679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.877600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.877694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.877720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.877744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.877758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.877789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.887576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.887670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.971 [2024-10-16 07:26:02.887695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.971 [2024-10-16 07:26:02.887709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.971 [2024-10-16 07:26:02.887722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.971 [2024-10-16 07:26:02.887762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.971 qpair failed and we were unable to recover it. 00:27:59.971 [2024-10-16 07:26:02.897661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.971 [2024-10-16 07:26:02.897756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.972 [2024-10-16 07:26:02.897781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.972 [2024-10-16 07:26:02.897796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.972 [2024-10-16 07:26:02.897810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.972 [2024-10-16 07:26:02.897849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.972 qpair failed and we were unable to recover it. 00:27:59.972 [2024-10-16 07:26:02.907585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.972 [2024-10-16 07:26:02.907714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.972 [2024-10-16 07:26:02.907748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.972 [2024-10-16 07:26:02.907763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.972 [2024-10-16 07:26:02.907777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:27:59.972 [2024-10-16 07:26:02.907807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.972 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.917621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.917714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.917748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.917763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.917777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.917807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.927672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.927766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.927792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.927806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.927820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.927849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.937688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.937789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.937815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.937829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.937842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.937873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.947715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.947815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.947840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.947854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.947867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.947897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.957744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.957840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.957866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.957880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.957893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.957923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.967792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.967896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.967922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.967936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.967949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.967979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.977814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.977904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.977930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.977944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.977957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.977987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.987863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.987957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.987984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.987998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.988017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.988062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:02.997876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:02.997979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:02.998006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:02.998020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:02.998034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:02.998064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:03.007966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:03.008078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:03.008104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:03.008119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:03.008132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:03.008161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:03.017913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:03.018002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:03.018027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:03.018041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:03.018055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.231 [2024-10-16 07:26:03.018084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.231 qpair failed and we were unable to recover it. 00:28:00.231 [2024-10-16 07:26:03.027939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.231 [2024-10-16 07:26:03.028037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.231 [2024-10-16 07:26:03.028063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.231 [2024-10-16 07:26:03.028077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.231 [2024-10-16 07:26:03.028090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.028121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.038024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.038120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.038146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.038161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.038174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.038204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.048056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.048156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.048182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.048196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.048209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.048240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.058063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.058157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.058182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.058196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.058209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.058240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.068062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.068160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.068185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.068199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.068212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.068242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.078186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.078274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.078299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.078320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.078335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.078367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.088124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.088222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.088248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.088263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.088276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.088307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.098192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.098314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.098340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.098354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.098368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.098397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.108235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.108331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.108360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.108374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.108388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.108417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.118249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.118350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.118380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.118396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.118410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.118440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.128316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.128416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.128442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.128456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.128470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.128500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.138301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.138434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.138460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.138475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.138488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.138518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.148320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.148414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.148439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.148454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.148467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.148498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.158329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.158424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.158450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.158464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.158477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.158506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.232 [2024-10-16 07:26:03.168382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.232 [2024-10-16 07:26:03.168486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.232 [2024-10-16 07:26:03.168512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.232 [2024-10-16 07:26:03.168534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.232 [2024-10-16 07:26:03.168548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.232 [2024-10-16 07:26:03.168592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.232 qpair failed and we were unable to recover it. 00:28:00.491 [2024-10-16 07:26:03.178385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.491 [2024-10-16 07:26:03.178475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.491 [2024-10-16 07:26:03.178501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.491 [2024-10-16 07:26:03.178515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.491 [2024-10-16 07:26:03.178528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.491 [2024-10-16 07:26:03.178559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.491 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.188482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.188598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.188625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.188640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.188654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.188683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.198512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.198620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.198646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.198661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.198674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.198717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.208586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.208686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.208716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.208739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.208754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.208786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.218486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.218580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.218607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.218622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.218635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.218665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.228534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.228643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.228670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.228684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.228697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.228735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.238552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.238641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.238667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.238682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.238694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.238725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.248639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.248748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.248774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.248788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.248801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.248833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.258702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.258802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.258832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.258847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.258860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.258888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.268751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.268866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.268893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.268908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.268921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.268955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.278674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.278764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.278790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.278805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.278818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.278849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.288761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.288872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.288898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.288912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.288925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.288955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.298732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.298824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.298850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.298864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.298877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.298913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.492 qpair failed and we were unable to recover it. 00:28:00.492 [2024-10-16 07:26:03.308786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.492 [2024-10-16 07:26:03.308888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.492 [2024-10-16 07:26:03.308916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.492 [2024-10-16 07:26:03.308932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.492 [2024-10-16 07:26:03.308944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.492 [2024-10-16 07:26:03.308974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.318818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.318914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.318940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.318954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.318968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.318997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.328851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.328950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.328976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.328990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.329003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.329033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.338868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.338960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.338985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.338999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.339013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.339042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.348868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.348997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.349028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.349044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.349057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.349086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.358916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.359003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.359028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.359043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.359056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.359100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.368985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.369086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.369111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.369126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.369139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.369168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.379001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.379095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.379120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.379134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.379146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.379178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.389035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.389158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.389183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.389199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.389213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.389249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.399022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.399111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.399138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.399152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.399165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.399195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.409110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.409204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.409230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.409245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.409258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.409301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.419105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.419240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.419266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.419280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.419293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.419324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.493 [2024-10-16 07:26:03.429154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.493 [2024-10-16 07:26:03.429240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.493 [2024-10-16 07:26:03.429266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.493 [2024-10-16 07:26:03.429281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.493 [2024-10-16 07:26:03.429294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.493 [2024-10-16 07:26:03.429324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.493 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.439133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.439231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.439263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.439278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.439291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.439321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.449285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.449380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.449405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.449419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.449433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.449462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.459216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.459308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.459333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.459347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.459360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.459390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.469254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.469394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.469420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.469434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.469448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.469478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.479259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.479387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.479414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.479428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.479447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.479493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.489315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.489402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.489428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.489443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.489456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.489485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.499430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.499527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.499556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.499572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.499585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.499618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.509397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.509487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.509513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.509527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.509540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.509571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.519394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.519486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.519512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.519527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.519540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.519569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.529488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.529627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.753 [2024-10-16 07:26:03.529653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.753 [2024-10-16 07:26:03.529668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.753 [2024-10-16 07:26:03.529681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.753 [2024-10-16 07:26:03.529711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.753 qpair failed and we were unable to recover it. 00:28:00.753 [2024-10-16 07:26:03.539446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.753 [2024-10-16 07:26:03.539533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.539559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.539573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.539586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.539616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.549479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.549613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.549639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.549653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.549666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.549695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.559507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.559596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.559622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.559637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.559649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.559678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.569533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.569633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.569658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.569673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.569692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.569723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.579665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.579768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.579796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.579811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.579825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.579856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.589718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.589812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.589838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.589853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.589866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.589898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.599657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.599763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.599790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.599804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.599817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.599848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.609670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.609766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.609800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.609817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.609830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.609861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.619691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.619790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.619815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.619829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.619844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.619874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.629717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.629848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.629874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.629889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.629902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.629932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.639758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.639882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.639907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.639922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.639935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.639964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.649907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.650002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.754 [2024-10-16 07:26:03.650027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.754 [2024-10-16 07:26:03.650041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.754 [2024-10-16 07:26:03.650054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.754 [2024-10-16 07:26:03.650083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.754 qpair failed and we were unable to recover it. 00:28:00.754 [2024-10-16 07:26:03.659807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.754 [2024-10-16 07:26:03.659941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.755 [2024-10-16 07:26:03.659967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.755 [2024-10-16 07:26:03.659988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.755 [2024-10-16 07:26:03.660002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.755 [2024-10-16 07:26:03.660032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.755 qpair failed and we were unable to recover it. 00:28:00.755 [2024-10-16 07:26:03.669887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.755 [2024-10-16 07:26:03.669980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.755 [2024-10-16 07:26:03.670006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.755 [2024-10-16 07:26:03.670020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.755 [2024-10-16 07:26:03.670033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.755 [2024-10-16 07:26:03.670063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.755 qpair failed and we were unable to recover it. 00:28:00.755 [2024-10-16 07:26:03.679904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.755 [2024-10-16 07:26:03.680035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.755 [2024-10-16 07:26:03.680061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.755 [2024-10-16 07:26:03.680075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.755 [2024-10-16 07:26:03.680088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.755 [2024-10-16 07:26:03.680118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.755 qpair failed and we were unable to recover it. 00:28:00.755 [2024-10-16 07:26:03.689903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:00.755 [2024-10-16 07:26:03.689996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:00.755 [2024-10-16 07:26:03.690022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:00.755 [2024-10-16 07:26:03.690036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:00.755 [2024-10-16 07:26:03.690049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:00.755 [2024-10-16 07:26:03.690078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:00.755 qpair failed and we were unable to recover it. 00:28:01.012 [2024-10-16 07:26:03.700013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.012 [2024-10-16 07:26:03.700108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.012 [2024-10-16 07:26:03.700133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.012 [2024-10-16 07:26:03.700148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.012 [2024-10-16 07:26:03.700163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.012 [2024-10-16 07:26:03.700195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.012 qpair failed and we were unable to recover it. 00:28:01.012 [2024-10-16 07:26:03.709972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.012 [2024-10-16 07:26:03.710081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.012 [2024-10-16 07:26:03.710107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.012 [2024-10-16 07:26:03.710121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.012 [2024-10-16 07:26:03.710134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.710163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.720019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.720108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.720137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.720153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.720166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.720197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.730029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.730126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.730152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.730167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.730180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.730210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.740134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.740229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.740255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.740269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.740282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.740311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.750157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.750247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.750274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.750294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.750307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.750337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.760147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.760290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.760315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.760330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.760343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.760373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.770196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.770305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.770330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.770344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.770357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.770387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.780304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.780401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.780440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.780456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.780469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.780499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.790238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.790333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.790358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.790373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.790386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.790415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.800250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.800337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.800363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.800377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.800390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.800419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.810273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.810365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.810390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.810404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.810417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.810447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.820418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.820549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.820575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.820590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.820603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.820636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.830355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.830485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.830511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.830525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.830539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.830570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.840343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.840431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.840462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.840477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.013 [2024-10-16 07:26:03.840490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.013 [2024-10-16 07:26:03.840521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.013 qpair failed and we were unable to recover it. 00:28:01.013 [2024-10-16 07:26:03.850484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.013 [2024-10-16 07:26:03.850581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.013 [2024-10-16 07:26:03.850607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.013 [2024-10-16 07:26:03.850621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.850635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.850664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.860419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.860518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.860543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.860558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.860571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.860600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.870447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.870540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.870569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.870584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.870598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.870628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.880468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.880558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.880584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.880599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.880612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.880647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.890518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.890617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.890643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.890657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.890670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.890700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.900564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.900679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.900708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.900723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.900748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.900778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.910540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.910651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.910677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.910691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.910704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.910747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.920564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.920659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.920685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.920699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.920712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.920751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.930667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.930771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.930802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.930817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.930830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.930859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.940648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.940750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.940776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.940790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.940803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.940833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.014 [2024-10-16 07:26:03.950676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.014 [2024-10-16 07:26:03.950777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.014 [2024-10-16 07:26:03.950803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.014 [2024-10-16 07:26:03.950817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.014 [2024-10-16 07:26:03.950830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.014 [2024-10-16 07:26:03.950861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.014 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:03.960694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:03.960789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:03.960815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:03.960829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:03.960842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:03.960872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:03.970777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:03.970875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:03.970900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:03.970915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:03.970933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:03.970963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:03.980782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:03.980887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:03.980916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:03.980932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:03.980946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:03.980978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:03.990888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:03.990986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:03.991016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:03.991032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:03.991045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:03.991076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:04.000859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:04.000953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:04.000980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:04.000994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:04.001007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:04.001037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.273 qpair failed and we were unable to recover it. 00:28:01.273 [2024-10-16 07:26:04.010858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.273 [2024-10-16 07:26:04.010954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.273 [2024-10-16 07:26:04.010979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.273 [2024-10-16 07:26:04.010994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.273 [2024-10-16 07:26:04.011007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.273 [2024-10-16 07:26:04.011037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.020885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.020985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.021011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.021025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.021038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.021070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.030935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.031024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.031049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.031063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.031076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.031106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.040955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.041042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.041068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.041082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.041095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.041125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.051070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.051164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.051190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.051205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.051218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.051247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.061029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.061123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.061149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.061163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.061182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.061211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.071021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.071108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.071134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.071148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.071161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.071190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.081057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.081144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.081170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.081185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.081198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.081227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.091125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.091224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.091249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.091263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.091276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.091307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.101131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.101252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.101277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.101291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.101304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.101334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.111178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.111302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.111328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.111342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.111356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.111386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.121199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.121287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.121312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.121326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.121340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.121369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.131308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.131443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.131468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.131482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.131495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.131524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.141319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.141457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.141482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.141496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.141509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.141538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.274 [2024-10-16 07:26:04.151269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.274 [2024-10-16 07:26:04.151362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.274 [2024-10-16 07:26:04.151388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.274 [2024-10-16 07:26:04.151409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.274 [2024-10-16 07:26:04.151422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.274 [2024-10-16 07:26:04.151452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.274 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.161389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.161481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.161507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.161521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.161534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.161563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.171331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.171424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.171449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.171464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.171476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.171505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.181364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.181459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.181485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.181499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.181513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.181558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.191463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.191585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.191612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.191626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.191639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.191669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.201435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.201521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.201547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.201561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.201575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.201604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.275 [2024-10-16 07:26:04.211438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.275 [2024-10-16 07:26:04.211533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.275 [2024-10-16 07:26:04.211559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.275 [2024-10-16 07:26:04.211573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.275 [2024-10-16 07:26:04.211587] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.275 [2024-10-16 07:26:04.211616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.275 qpair failed and we were unable to recover it. 00:28:01.535 [2024-10-16 07:26:04.221568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.535 [2024-10-16 07:26:04.221676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.535 [2024-10-16 07:26:04.221702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.221716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.221739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.221771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.231518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.231607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.231633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.231647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.231660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.231692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.241519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.241609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.241634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.241655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.241668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.241698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.251571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.251664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.251690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.251704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.251717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.251754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.261606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.261692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.261717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.261741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.261756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.261785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.271635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.271759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.271785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.271799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.271812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.271843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.281741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.281831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.281857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.281871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.281884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.281914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.291691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.291805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.291832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.291846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.291860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.291903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.301712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.301820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.301850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.301866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.301879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.301909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.311721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.311818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.311843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.311856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.311869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.536 [2024-10-16 07:26:04.311898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.536 qpair failed and we were unable to recover it. 00:28:01.536 [2024-10-16 07:26:04.321805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.536 [2024-10-16 07:26:04.321898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.536 [2024-10-16 07:26:04.321925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.536 [2024-10-16 07:26:04.321939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.536 [2024-10-16 07:26:04.321952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.321982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.331824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.331926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.331957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.331973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.331986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.332016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.341847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.341942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.341968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.341983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.341997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.342027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.351867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.351966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.351996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.352011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.352025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.352055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.361894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.361989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.362014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.362029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.362042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.362071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.371950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.372047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.372072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.372087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.372101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.372136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.381993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.382094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.382131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.382146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.382159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.382193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.392056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.392156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.392182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.392198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.392211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.392241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.402076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.402166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.402192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.402206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.402219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.402250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.412145] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.412265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.412291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.412306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.412319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.412349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.422131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.422228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.537 [2024-10-16 07:26:04.422262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.537 [2024-10-16 07:26:04.422277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.537 [2024-10-16 07:26:04.422291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.537 [2024-10-16 07:26:04.422321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.537 qpair failed and we were unable to recover it. 00:28:01.537 [2024-10-16 07:26:04.432076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.537 [2024-10-16 07:26:04.432167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.538 [2024-10-16 07:26:04.432193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.538 [2024-10-16 07:26:04.432207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.538 [2024-10-16 07:26:04.432221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.538 [2024-10-16 07:26:04.432264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.538 qpair failed and we were unable to recover it. 00:28:01.538 [2024-10-16 07:26:04.442138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.538 [2024-10-16 07:26:04.442229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.538 [2024-10-16 07:26:04.442256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.538 [2024-10-16 07:26:04.442270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.538 [2024-10-16 07:26:04.442283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.538 [2024-10-16 07:26:04.442314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.538 qpair failed and we were unable to recover it. 00:28:01.538 [2024-10-16 07:26:04.452227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.538 [2024-10-16 07:26:04.452321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.538 [2024-10-16 07:26:04.452347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.538 [2024-10-16 07:26:04.452361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.538 [2024-10-16 07:26:04.452375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b4000b90 00:28:01.538 [2024-10-16 07:26:04.452406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:01.538 qpair failed and we were unable to recover it. 00:28:01.538 [2024-10-16 07:26:04.462178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.538 [2024-10-16 07:26:04.462270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.538 [2024-10-16 07:26:04.462302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.538 [2024-10-16 07:26:04.462319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.538 [2024-10-16 07:26:04.462332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47c0000b90 00:28:01.538 [2024-10-16 07:26:04.462369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.538 qpair failed and we were unable to recover it. 00:28:01.538 [2024-10-16 07:26:04.472222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.538 [2024-10-16 07:26:04.472316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.538 [2024-10-16 07:26:04.472347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.538 [2024-10-16 07:26:04.472363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.538 [2024-10-16 07:26:04.472376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47c0000b90 00:28:01.538 [2024-10-16 07:26:04.472409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:01.538 qpair failed and we were unable to recover it. 00:28:01.836 [2024-10-16 07:26:04.482260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.836 [2024-10-16 07:26:04.482352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.836 [2024-10-16 07:26:04.482388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.836 [2024-10-16 07:26:04.482405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.836 [2024-10-16 07:26:04.482420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf27cb0 00:28:01.836 [2024-10-16 07:26:04.482451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-10-16 07:26:04.492253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.836 [2024-10-16 07:26:04.492348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.836 [2024-10-16 07:26:04.492375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.836 [2024-10-16 07:26:04.492390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.836 [2024-10-16 07:26:04.492403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf27cb0 00:28:01.836 [2024-10-16 07:26:04.492432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-10-16 07:26:04.492536] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:01.836 A controller has encountered a failure and is being reset. 00:28:01.836 [2024-10-16 07:26:04.502294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.836 [2024-10-16 07:26:04.502393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.836 [2024-10-16 07:26:04.502426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.836 [2024-10-16 07:26:04.502442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.836 [2024-10-16 07:26:04.502456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b8000b90 00:28:01.836 [2024-10-16 07:26:04.502488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 [2024-10-16 07:26:04.512294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:01.836 [2024-10-16 07:26:04.512383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:01.836 [2024-10-16 07:26:04.512411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:01.836 [2024-10-16 07:26:04.512426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:01.836 [2024-10-16 07:26:04.512440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f47b8000b90 00:28:01.836 [2024-10-16 07:26:04.512471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:01.836 qpair failed and we were unable to recover it. 00:28:01.836 Controller properly reset. 00:28:01.836 Initializing NVMe Controllers 00:28:01.836 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:01.836 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:01.836 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:01.836 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:01.836 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:01.836 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:01.836 Initialization complete. Launching workers. 00:28:01.836 Starting thread on core 1 00:28:01.836 Starting thread on core 2 00:28:01.836 Starting thread on core 3 00:28:01.836 Starting thread on core 0 00:28:01.836 07:26:04 -- host/target_disconnect.sh@59 -- # sync 00:28:01.836 00:28:01.836 real 0m11.542s 00:28:01.836 user 0m21.950s 00:28:01.836 sys 0m5.223s 00:28:01.836 07:26:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:01.836 07:26:04 -- common/autotest_common.sh@10 -- # set +x 00:28:01.836 ************************************ 00:28:01.836 END TEST nvmf_target_disconnect_tc2 00:28:01.836 ************************************ 00:28:01.836 07:26:04 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:01.836 07:26:04 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:01.836 07:26:04 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:01.836 07:26:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:01.836 07:26:04 -- nvmf/common.sh@116 -- # sync 00:28:01.836 07:26:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:01.836 07:26:04 -- nvmf/common.sh@119 -- # set +e 00:28:01.836 07:26:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:01.837 07:26:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:01.837 rmmod nvme_tcp 00:28:01.837 rmmod nvme_fabrics 00:28:01.837 rmmod nvme_keyring 00:28:01.837 07:26:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:01.837 07:26:04 -- nvmf/common.sh@123 -- # set -e 00:28:01.837 07:26:04 -- nvmf/common.sh@124 -- # return 0 00:28:01.837 07:26:04 -- nvmf/common.sh@477 -- # '[' -n 2025220 ']' 00:28:01.837 07:26:04 -- nvmf/common.sh@478 -- # killprocess 2025220 00:28:01.837 07:26:04 -- common/autotest_common.sh@926 -- # '[' -z 2025220 ']' 00:28:01.837 07:26:04 -- common/autotest_common.sh@930 -- # kill -0 2025220 00:28:01.837 07:26:04 -- common/autotest_common.sh@931 -- # uname 00:28:01.837 07:26:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:01.837 07:26:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2025220 00:28:01.837 07:26:04 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:28:01.837 07:26:04 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:28:01.837 07:26:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2025220' 00:28:01.837 killing process with pid 2025220 00:28:01.837 07:26:04 -- common/autotest_common.sh@945 -- # kill 2025220 00:28:01.837 07:26:04 -- common/autotest_common.sh@950 -- # wait 2025220 00:28:02.401 07:26:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:02.401 07:26:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:02.401 07:26:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:02.401 07:26:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:02.401 07:26:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:02.401 07:26:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.401 07:26:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.401 07:26:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:04.303 07:26:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:04.303 00:28:04.303 real 0m16.343s 00:28:04.303 user 0m48.440s 00:28:04.303 sys 0m7.191s 00:28:04.303 07:26:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:04.303 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.303 ************************************ 00:28:04.303 END TEST nvmf_target_disconnect 00:28:04.303 ************************************ 00:28:04.303 07:26:07 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:04.303 07:26:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:04.303 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.303 07:26:07 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:04.303 00:28:04.303 real 21m22.486s 00:28:04.303 user 62m15.875s 00:28:04.303 sys 4m53.547s 00:28:04.303 07:26:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:04.303 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.303 ************************************ 00:28:04.303 END TEST nvmf_tcp 00:28:04.303 ************************************ 00:28:04.303 07:26:07 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:28:04.303 07:26:07 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:04.303 07:26:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:04.303 07:26:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:04.303 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.303 ************************************ 00:28:04.303 START TEST spdkcli_nvmf_tcp 00:28:04.303 ************************************ 00:28:04.303 07:26:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:04.303 * Looking for test storage... 00:28:04.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:04.303 07:26:07 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:04.303 07:26:07 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:04.303 07:26:07 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:04.303 07:26:07 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:04.303 07:26:07 -- nvmf/common.sh@7 -- # uname -s 00:28:04.303 07:26:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:04.303 07:26:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:04.303 07:26:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:04.303 07:26:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:04.303 07:26:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:04.303 07:26:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:04.303 07:26:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:04.303 07:26:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:04.303 07:26:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:04.303 07:26:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:04.303 07:26:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:04.303 07:26:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:04.560 07:26:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:04.560 07:26:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:04.560 07:26:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:04.560 07:26:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:04.560 07:26:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:04.560 07:26:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:04.560 07:26:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:04.560 07:26:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.560 07:26:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.560 07:26:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.560 07:26:07 -- paths/export.sh@5 -- # export PATH 00:28:04.560 07:26:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.560 07:26:07 -- nvmf/common.sh@46 -- # : 0 00:28:04.560 07:26:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:04.560 07:26:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:04.560 07:26:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:04.560 07:26:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:04.560 07:26:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:04.560 07:26:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:04.560 07:26:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:04.560 07:26:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:04.560 07:26:07 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:04.560 07:26:07 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:04.560 07:26:07 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:04.560 07:26:07 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:04.560 07:26:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:04.560 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.560 07:26:07 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:04.560 07:26:07 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2026440 00:28:04.560 07:26:07 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:04.560 07:26:07 -- spdkcli/common.sh@34 -- # waitforlisten 2026440 00:28:04.560 07:26:07 -- common/autotest_common.sh@819 -- # '[' -z 2026440 ']' 00:28:04.560 07:26:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:04.560 07:26:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:04.560 07:26:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:04.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:04.560 07:26:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:04.560 07:26:07 -- common/autotest_common.sh@10 -- # set +x 00:28:04.560 [2024-10-16 07:26:07.300621] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:04.560 [2024-10-16 07:26:07.300705] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2026440 ] 00:28:04.560 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.560 [2024-10-16 07:26:07.355809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:04.560 [2024-10-16 07:26:07.464606] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:04.560 [2024-10-16 07:26:07.464833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:04.560 [2024-10-16 07:26:07.464839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:05.493 07:26:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:05.493 07:26:08 -- common/autotest_common.sh@852 -- # return 0 00:28:05.493 07:26:08 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:05.493 07:26:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:05.493 07:26:08 -- common/autotest_common.sh@10 -- # set +x 00:28:05.493 07:26:08 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:05.493 07:26:08 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:05.493 07:26:08 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:05.493 07:26:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:05.493 07:26:08 -- common/autotest_common.sh@10 -- # set +x 00:28:05.493 07:26:08 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:05.493 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:05.493 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:05.493 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:05.493 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:05.493 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:05.493 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:05.493 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:05.493 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:05.493 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:05.493 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:05.493 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:05.493 ' 00:28:06.059 [2024-10-16 07:26:08.719789] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:08.586 [2024-10-16 07:26:10.918876] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:09.516 [2024-10-16 07:26:12.187433] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:12.042 [2024-10-16 07:26:14.490744] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:13.942 [2024-10-16 07:26:16.493327] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:15.322 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:15.322 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:15.322 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.322 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.322 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:15.322 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:15.322 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:15.322 07:26:18 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:15.322 07:26:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:15.322 07:26:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.322 07:26:18 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:15.322 07:26:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:15.322 07:26:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.322 07:26:18 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:15.322 07:26:18 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:15.888 07:26:18 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:15.888 07:26:18 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:15.888 07:26:18 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:15.888 07:26:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:15.888 07:26:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.888 07:26:18 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:15.888 07:26:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:15.888 07:26:18 -- common/autotest_common.sh@10 -- # set +x 00:28:15.888 07:26:18 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:15.888 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:15.888 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:15.888 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:15.888 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:15.888 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:15.888 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:15.888 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:15.888 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:15.888 ' 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:21.149 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:21.149 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:21.149 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:21.149 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:21.149 07:26:23 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:21.149 07:26:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:21.149 07:26:23 -- common/autotest_common.sh@10 -- # set +x 00:28:21.149 07:26:23 -- spdkcli/nvmf.sh@90 -- # killprocess 2026440 00:28:21.149 07:26:23 -- common/autotest_common.sh@926 -- # '[' -z 2026440 ']' 00:28:21.149 07:26:23 -- common/autotest_common.sh@930 -- # kill -0 2026440 00:28:21.149 07:26:23 -- common/autotest_common.sh@931 -- # uname 00:28:21.149 07:26:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:21.149 07:26:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2026440 00:28:21.149 07:26:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:21.149 07:26:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:21.149 07:26:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2026440' 00:28:21.149 killing process with pid 2026440 00:28:21.149 07:26:24 -- common/autotest_common.sh@945 -- # kill 2026440 00:28:21.149 [2024-10-16 07:26:24.001176] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:21.149 07:26:24 -- common/autotest_common.sh@950 -- # wait 2026440 00:28:21.408 07:26:24 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:21.408 07:26:24 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:21.408 07:26:24 -- spdkcli/common.sh@13 -- # '[' -n 2026440 ']' 00:28:21.408 07:26:24 -- spdkcli/common.sh@14 -- # killprocess 2026440 00:28:21.408 07:26:24 -- common/autotest_common.sh@926 -- # '[' -z 2026440 ']' 00:28:21.408 07:26:24 -- common/autotest_common.sh@930 -- # kill -0 2026440 00:28:21.408 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2026440) - No such process 00:28:21.408 07:26:24 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2026440 is not found' 00:28:21.408 Process with pid 2026440 is not found 00:28:21.408 07:26:24 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:21.408 07:26:24 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:21.408 07:26:24 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:21.408 00:28:21.408 real 0m17.093s 00:28:21.408 user 0m36.629s 00:28:21.408 sys 0m0.779s 00:28:21.408 07:26:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:21.408 07:26:24 -- common/autotest_common.sh@10 -- # set +x 00:28:21.408 ************************************ 00:28:21.408 END TEST spdkcli_nvmf_tcp 00:28:21.408 ************************************ 00:28:21.408 07:26:24 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:21.408 07:26:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:21.408 07:26:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:21.408 07:26:24 -- common/autotest_common.sh@10 -- # set +x 00:28:21.408 ************************************ 00:28:21.408 START TEST nvmf_identify_passthru 00:28:21.408 ************************************ 00:28:21.408 07:26:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:21.408 * Looking for test storage... 00:28:21.408 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:21.408 07:26:24 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:21.408 07:26:24 -- nvmf/common.sh@7 -- # uname -s 00:28:21.408 07:26:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:21.408 07:26:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:21.408 07:26:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:21.408 07:26:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:21.408 07:26:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:21.408 07:26:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:21.408 07:26:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:21.408 07:26:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:21.408 07:26:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:21.408 07:26:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:21.666 07:26:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:21.666 07:26:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:21.666 07:26:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:21.666 07:26:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:21.666 07:26:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:21.666 07:26:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:21.666 07:26:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:21.666 07:26:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:21.666 07:26:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:21.666 07:26:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.666 07:26:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- paths/export.sh@5 -- # export PATH 00:28:21.667 07:26:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- nvmf/common.sh@46 -- # : 0 00:28:21.667 07:26:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:21.667 07:26:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:21.667 07:26:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:21.667 07:26:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:21.667 07:26:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:21.667 07:26:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:21.667 07:26:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:21.667 07:26:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:21.667 07:26:24 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:21.667 07:26:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:21.667 07:26:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:21.667 07:26:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:21.667 07:26:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- paths/export.sh@5 -- # export PATH 00:28:21.667 07:26:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:21.667 07:26:24 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:21.667 07:26:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:21.667 07:26:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:21.667 07:26:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:21.667 07:26:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:21.667 07:26:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:21.667 07:26:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:21.667 07:26:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:21.667 07:26:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:21.667 07:26:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:21.667 07:26:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:21.667 07:26:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:21.667 07:26:24 -- common/autotest_common.sh@10 -- # set +x 00:28:23.569 07:26:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:23.569 07:26:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:23.569 07:26:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:23.569 07:26:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:23.569 07:26:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:23.569 07:26:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:23.569 07:26:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:23.569 07:26:26 -- nvmf/common.sh@294 -- # net_devs=() 00:28:23.569 07:26:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:23.569 07:26:26 -- nvmf/common.sh@295 -- # e810=() 00:28:23.569 07:26:26 -- nvmf/common.sh@295 -- # local -ga e810 00:28:23.569 07:26:26 -- nvmf/common.sh@296 -- # x722=() 00:28:23.569 07:26:26 -- nvmf/common.sh@296 -- # local -ga x722 00:28:23.569 07:26:26 -- nvmf/common.sh@297 -- # mlx=() 00:28:23.569 07:26:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:23.569 07:26:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:23.569 07:26:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:23.569 07:26:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:23.569 07:26:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:23.569 07:26:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:23.569 07:26:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:23.569 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:23.569 07:26:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:23.569 07:26:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:23.569 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:23.569 07:26:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:23.569 07:26:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:23.570 07:26:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:23.570 07:26:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.570 07:26:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:23.570 07:26:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.570 07:26:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:23.570 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:23.570 07:26:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.570 07:26:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:23.570 07:26:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:23.570 07:26:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:23.570 07:26:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:23.570 07:26:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:23.570 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:23.570 07:26:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:23.570 07:26:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:23.570 07:26:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:23.570 07:26:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:23.570 07:26:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:23.570 07:26:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:23.570 07:26:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:23.570 07:26:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:23.570 07:26:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:23.570 07:26:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:23.570 07:26:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:23.570 07:26:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:23.570 07:26:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:23.570 07:26:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:23.570 07:26:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:23.570 07:26:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:23.570 07:26:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:23.570 07:26:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:23.570 07:26:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:23.570 07:26:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:23.570 07:26:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:23.570 07:26:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:23.570 07:26:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:23.570 07:26:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:23.570 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:23.570 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:28:23.570 00:28:23.570 --- 10.0.0.2 ping statistics --- 00:28:23.570 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.570 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:28:23.570 07:26:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:23.570 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:23.570 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:28:23.570 00:28:23.570 --- 10.0.0.1 ping statistics --- 00:28:23.570 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:23.570 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:28:23.570 07:26:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:23.570 07:26:26 -- nvmf/common.sh@410 -- # return 0 00:28:23.570 07:26:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:23.570 07:26:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:23.570 07:26:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:23.570 07:26:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:23.570 07:26:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:23.570 07:26:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:23.829 07:26:26 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:23.829 07:26:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:23.829 07:26:26 -- common/autotest_common.sh@10 -- # set +x 00:28:23.829 07:26:26 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:23.829 07:26:26 -- common/autotest_common.sh@1509 -- # bdfs=() 00:28:23.829 07:26:26 -- common/autotest_common.sh@1509 -- # local bdfs 00:28:23.829 07:26:26 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:28:23.829 07:26:26 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:28:23.829 07:26:26 -- common/autotest_common.sh@1498 -- # bdfs=() 00:28:23.829 07:26:26 -- common/autotest_common.sh@1498 -- # local bdfs 00:28:23.829 07:26:26 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:23.829 07:26:26 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:23.829 07:26:26 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:28:23.829 07:26:26 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:28:23.829 07:26:26 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:28:23.829 07:26:26 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:28:23.829 07:26:26 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:23.829 07:26:26 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:23.829 07:26:26 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:23.829 07:26:26 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:23.829 07:26:26 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:23.829 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.016 07:26:30 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:28.016 07:26:30 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:28.016 07:26:30 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:28.016 07:26:30 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:28.016 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.201 07:26:34 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:32.201 07:26:34 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:32.201 07:26:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:32.201 07:26:34 -- common/autotest_common.sh@10 -- # set +x 00:28:32.201 07:26:34 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:32.201 07:26:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:32.201 07:26:34 -- common/autotest_common.sh@10 -- # set +x 00:28:32.201 07:26:34 -- target/identify_passthru.sh@31 -- # nvmfpid=2031177 00:28:32.201 07:26:34 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:32.201 07:26:34 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:32.201 07:26:34 -- target/identify_passthru.sh@35 -- # waitforlisten 2031177 00:28:32.201 07:26:34 -- common/autotest_common.sh@819 -- # '[' -z 2031177 ']' 00:28:32.201 07:26:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:32.201 07:26:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:32.201 07:26:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:32.201 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:32.201 07:26:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:32.201 07:26:34 -- common/autotest_common.sh@10 -- # set +x 00:28:32.201 [2024-10-16 07:26:35.016485] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:32.201 [2024-10-16 07:26:35.016575] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:32.201 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.201 [2024-10-16 07:26:35.081882] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:32.458 [2024-10-16 07:26:35.195926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:32.458 [2024-10-16 07:26:35.196076] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:32.458 [2024-10-16 07:26:35.196101] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:32.458 [2024-10-16 07:26:35.196129] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:32.458 [2024-10-16 07:26:35.196189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:32.458 [2024-10-16 07:26:35.196249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:32.458 [2024-10-16 07:26:35.196314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:32.458 [2024-10-16 07:26:35.196322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:32.458 07:26:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:32.458 07:26:35 -- common/autotest_common.sh@852 -- # return 0 00:28:32.458 07:26:35 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:32.458 07:26:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.458 07:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:32.458 INFO: Log level set to 20 00:28:32.458 INFO: Requests: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "method": "nvmf_set_config", 00:28:32.458 "id": 1, 00:28:32.458 "params": { 00:28:32.458 "admin_cmd_passthru": { 00:28:32.458 "identify_ctrlr": true 00:28:32.458 } 00:28:32.458 } 00:28:32.458 } 00:28:32.458 00:28:32.458 INFO: response: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "id": 1, 00:28:32.458 "result": true 00:28:32.458 } 00:28:32.458 00:28:32.458 07:26:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.458 07:26:35 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:32.458 07:26:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.458 07:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:32.458 INFO: Setting log level to 20 00:28:32.458 INFO: Setting log level to 20 00:28:32.458 INFO: Log level set to 20 00:28:32.458 INFO: Log level set to 20 00:28:32.458 INFO: Requests: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "method": "framework_start_init", 00:28:32.458 "id": 1 00:28:32.458 } 00:28:32.458 00:28:32.458 INFO: Requests: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "method": "framework_start_init", 00:28:32.458 "id": 1 00:28:32.458 } 00:28:32.458 00:28:32.458 [2024-10-16 07:26:35.358129] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:32.458 INFO: response: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "id": 1, 00:28:32.458 "result": true 00:28:32.458 } 00:28:32.458 00:28:32.458 INFO: response: 00:28:32.458 { 00:28:32.458 "jsonrpc": "2.0", 00:28:32.458 "id": 1, 00:28:32.458 "result": true 00:28:32.458 } 00:28:32.458 00:28:32.458 07:26:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.458 07:26:35 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:32.458 07:26:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.458 07:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:32.458 INFO: Setting log level to 40 00:28:32.458 INFO: Setting log level to 40 00:28:32.458 INFO: Setting log level to 40 00:28:32.458 [2024-10-16 07:26:35.368212] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:32.459 07:26:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.459 07:26:35 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:32.459 07:26:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:32.459 07:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:32.716 07:26:35 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:32.716 07:26:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.716 07:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 Nvme0n1 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:35.997 07:26:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.997 07:26:38 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:35.997 07:26:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.997 07:26:38 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:35.997 07:26:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.997 07:26:38 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 [2024-10-16 07:26:38.265973] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:35.997 07:26:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.997 07:26:38 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 [2024-10-16 07:26:38.273658] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:35.997 [ 00:28:35.997 { 00:28:35.997 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:35.997 "subtype": "Discovery", 00:28:35.997 "listen_addresses": [], 00:28:35.997 "allow_any_host": true, 00:28:35.997 "hosts": [] 00:28:35.997 }, 00:28:35.997 { 00:28:35.997 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:35.997 "subtype": "NVMe", 00:28:35.997 "listen_addresses": [ 00:28:35.997 { 00:28:35.997 "transport": "TCP", 00:28:35.997 "trtype": "TCP", 00:28:35.997 "adrfam": "IPv4", 00:28:35.997 "traddr": "10.0.0.2", 00:28:35.997 "trsvcid": "4420" 00:28:35.997 } 00:28:35.997 ], 00:28:35.997 "allow_any_host": true, 00:28:35.997 "hosts": [], 00:28:35.997 "serial_number": "SPDK00000000000001", 00:28:35.997 "model_number": "SPDK bdev Controller", 00:28:35.997 "max_namespaces": 1, 00:28:35.997 "min_cntlid": 1, 00:28:35.997 "max_cntlid": 65519, 00:28:35.997 "namespaces": [ 00:28:35.997 { 00:28:35.997 "nsid": 1, 00:28:35.997 "bdev_name": "Nvme0n1", 00:28:35.997 "name": "Nvme0n1", 00:28:35.997 "nguid": "B7B4A3F0E797482EA31EE8D884FF0111", 00:28:35.997 "uuid": "b7b4a3f0-e797-482e-a31e-e8d884ff0111" 00:28:35.997 } 00:28:35.997 ] 00:28:35.997 } 00:28:35.997 ] 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:35.997 EAL: No free 2048 kB hugepages reported on node 1 00:28:35.997 07:26:38 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:35.997 07:26:38 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:35.997 EAL: No free 2048 kB hugepages reported on node 1 00:28:35.997 07:26:38 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:35.997 07:26:38 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:35.997 07:26:38 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:35.997 07:26:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.997 07:26:38 -- common/autotest_common.sh@10 -- # set +x 00:28:35.997 07:26:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.997 07:26:38 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:35.997 07:26:38 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:35.997 07:26:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:35.997 07:26:38 -- nvmf/common.sh@116 -- # sync 00:28:35.997 07:26:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:35.997 07:26:38 -- nvmf/common.sh@119 -- # set +e 00:28:35.997 07:26:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:35.997 07:26:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:35.997 rmmod nvme_tcp 00:28:35.997 rmmod nvme_fabrics 00:28:35.997 rmmod nvme_keyring 00:28:35.997 07:26:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:35.997 07:26:38 -- nvmf/common.sh@123 -- # set -e 00:28:35.997 07:26:38 -- nvmf/common.sh@124 -- # return 0 00:28:35.997 07:26:38 -- nvmf/common.sh@477 -- # '[' -n 2031177 ']' 00:28:35.997 07:26:38 -- nvmf/common.sh@478 -- # killprocess 2031177 00:28:35.997 07:26:38 -- common/autotest_common.sh@926 -- # '[' -z 2031177 ']' 00:28:35.997 07:26:38 -- common/autotest_common.sh@930 -- # kill -0 2031177 00:28:35.997 07:26:38 -- common/autotest_common.sh@931 -- # uname 00:28:35.997 07:26:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:35.997 07:26:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2031177 00:28:35.997 07:26:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:35.997 07:26:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:35.997 07:26:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2031177' 00:28:35.997 killing process with pid 2031177 00:28:35.997 07:26:38 -- common/autotest_common.sh@945 -- # kill 2031177 00:28:35.997 [2024-10-16 07:26:38.783852] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:35.997 07:26:38 -- common/autotest_common.sh@950 -- # wait 2031177 00:28:37.896 07:26:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:37.896 07:26:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:37.896 07:26:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:37.896 07:26:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:37.896 07:26:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:37.896 07:26:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:37.896 07:26:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:37.896 07:26:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:39.799 07:26:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:39.799 00:28:39.799 real 0m18.133s 00:28:39.799 user 0m27.034s 00:28:39.799 sys 0m2.386s 00:28:39.799 07:26:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:39.799 07:26:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.799 ************************************ 00:28:39.799 END TEST nvmf_identify_passthru 00:28:39.799 ************************************ 00:28:39.799 07:26:42 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:39.799 07:26:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:39.799 07:26:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:39.799 07:26:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.799 ************************************ 00:28:39.799 START TEST nvmf_dif 00:28:39.799 ************************************ 00:28:39.799 07:26:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:39.799 * Looking for test storage... 00:28:39.799 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:39.799 07:26:42 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:39.799 07:26:42 -- nvmf/common.sh@7 -- # uname -s 00:28:39.799 07:26:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:39.799 07:26:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:39.799 07:26:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:39.799 07:26:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:39.799 07:26:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:39.799 07:26:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:39.799 07:26:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:39.799 07:26:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:39.799 07:26:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:39.799 07:26:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:39.799 07:26:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:39.799 07:26:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:39.799 07:26:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:39.799 07:26:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:39.799 07:26:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:39.799 07:26:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:39.799 07:26:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:39.799 07:26:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:39.799 07:26:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:39.799 07:26:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:39.799 07:26:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:39.799 07:26:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:39.799 07:26:42 -- paths/export.sh@5 -- # export PATH 00:28:39.799 07:26:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:39.799 07:26:42 -- nvmf/common.sh@46 -- # : 0 00:28:39.799 07:26:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:39.799 07:26:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:39.799 07:26:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:39.799 07:26:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:39.799 07:26:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:39.799 07:26:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:39.799 07:26:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:39.799 07:26:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:39.799 07:26:42 -- target/dif.sh@15 -- # NULL_META=16 00:28:39.799 07:26:42 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:39.799 07:26:42 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:39.799 07:26:42 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:39.799 07:26:42 -- target/dif.sh@135 -- # nvmftestinit 00:28:39.799 07:26:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:39.799 07:26:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:39.799 07:26:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:39.799 07:26:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:39.799 07:26:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:39.799 07:26:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:39.799 07:26:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:39.799 07:26:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:39.799 07:26:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:39.799 07:26:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:39.799 07:26:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:39.799 07:26:42 -- common/autotest_common.sh@10 -- # set +x 00:28:41.702 07:26:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:41.702 07:26:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:41.702 07:26:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:41.702 07:26:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:41.702 07:26:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:41.702 07:26:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:41.702 07:26:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:41.702 07:26:44 -- nvmf/common.sh@294 -- # net_devs=() 00:28:41.702 07:26:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:41.702 07:26:44 -- nvmf/common.sh@295 -- # e810=() 00:28:41.702 07:26:44 -- nvmf/common.sh@295 -- # local -ga e810 00:28:41.702 07:26:44 -- nvmf/common.sh@296 -- # x722=() 00:28:41.702 07:26:44 -- nvmf/common.sh@296 -- # local -ga x722 00:28:41.702 07:26:44 -- nvmf/common.sh@297 -- # mlx=() 00:28:41.702 07:26:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:41.702 07:26:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:41.702 07:26:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:41.702 07:26:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:41.702 07:26:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:41.702 07:26:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:41.702 07:26:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:41.702 07:26:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:41.702 07:26:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:41.702 07:26:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:41.702 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:41.702 07:26:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:41.702 07:26:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:41.702 07:26:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:41.703 07:26:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:41.703 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:41.703 07:26:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:41.703 07:26:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:41.703 07:26:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:41.703 07:26:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:41.703 07:26:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:41.703 07:26:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:41.703 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:41.703 07:26:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:41.703 07:26:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:41.703 07:26:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:41.703 07:26:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:41.703 07:26:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:41.703 07:26:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:41.703 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:41.703 07:26:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:41.703 07:26:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:41.703 07:26:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:41.703 07:26:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:41.703 07:26:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:41.703 07:26:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:41.703 07:26:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:41.703 07:26:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:41.703 07:26:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:41.703 07:26:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:41.703 07:26:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:41.703 07:26:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:41.703 07:26:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:41.703 07:26:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:41.703 07:26:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:41.703 07:26:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:41.703 07:26:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:41.703 07:26:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:41.961 07:26:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:41.961 07:26:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:41.961 07:26:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:41.961 07:26:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:41.961 07:26:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:41.961 07:26:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:41.961 07:26:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:41.961 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:41.961 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.406 ms 00:28:41.961 00:28:41.961 --- 10.0.0.2 ping statistics --- 00:28:41.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:41.961 rtt min/avg/max/mdev = 0.406/0.406/0.406/0.000 ms 00:28:41.961 07:26:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:41.961 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:41.961 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.196 ms 00:28:41.961 00:28:41.961 --- 10.0.0.1 ping statistics --- 00:28:41.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:41.961 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:28:41.961 07:26:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:41.961 07:26:44 -- nvmf/common.sh@410 -- # return 0 00:28:41.961 07:26:44 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:41.961 07:26:44 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:43.338 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:43.338 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:43.338 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:43.338 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:43.338 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:43.338 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:43.338 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:43.338 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:43.338 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:43.338 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:43.338 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:43.338 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:43.338 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:43.338 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:43.338 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:43.338 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:43.338 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:43.338 07:26:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:43.338 07:26:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:43.338 07:26:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:43.338 07:26:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:43.338 07:26:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:43.338 07:26:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:43.338 07:26:46 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:43.338 07:26:46 -- target/dif.sh@137 -- # nvmfappstart 00:28:43.338 07:26:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:43.338 07:26:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:43.338 07:26:46 -- common/autotest_common.sh@10 -- # set +x 00:28:43.338 07:26:46 -- nvmf/common.sh@469 -- # nvmfpid=2034496 00:28:43.338 07:26:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:43.338 07:26:46 -- nvmf/common.sh@470 -- # waitforlisten 2034496 00:28:43.338 07:26:46 -- common/autotest_common.sh@819 -- # '[' -z 2034496 ']' 00:28:43.338 07:26:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:43.338 07:26:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:43.338 07:26:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:43.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:43.338 07:26:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:43.338 07:26:46 -- common/autotest_common.sh@10 -- # set +x 00:28:43.338 [2024-10-16 07:26:46.130103] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:43.338 [2024-10-16 07:26:46.130173] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:43.338 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.338 [2024-10-16 07:26:46.194886] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:43.597 [2024-10-16 07:26:46.306752] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:43.597 [2024-10-16 07:26:46.306904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:43.597 [2024-10-16 07:26:46.306928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:43.597 [2024-10-16 07:26:46.306941] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:43.597 [2024-10-16 07:26:46.306984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:44.163 07:26:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:44.163 07:26:47 -- common/autotest_common.sh@852 -- # return 0 00:28:44.163 07:26:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:44.163 07:26:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:44.163 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 07:26:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:44.422 07:26:47 -- target/dif.sh@139 -- # create_transport 00:28:44.422 07:26:47 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:44.422 07:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 [2024-10-16 07:26:47.126159] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:44.422 07:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.422 07:26:47 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:44.422 07:26:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:44.422 07:26:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 ************************************ 00:28:44.422 START TEST fio_dif_1_default 00:28:44.422 ************************************ 00:28:44.422 07:26:47 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:28:44.422 07:26:47 -- target/dif.sh@86 -- # create_subsystems 0 00:28:44.422 07:26:47 -- target/dif.sh@28 -- # local sub 00:28:44.422 07:26:47 -- target/dif.sh@30 -- # for sub in "$@" 00:28:44.422 07:26:47 -- target/dif.sh@31 -- # create_subsystem 0 00:28:44.422 07:26:47 -- target/dif.sh@18 -- # local sub_id=0 00:28:44.422 07:26:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:44.422 07:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 bdev_null0 00:28:44.422 07:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.422 07:26:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:44.422 07:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 07:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.422 07:26:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:44.422 07:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 07:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.422 07:26:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:44.422 07:26:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.422 07:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:44.422 [2024-10-16 07:26:47.162400] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:44.422 07:26:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.422 07:26:47 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:44.422 07:26:47 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:44.422 07:26:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:44.422 07:26:47 -- nvmf/common.sh@520 -- # config=() 00:28:44.422 07:26:47 -- nvmf/common.sh@520 -- # local subsystem config 00:28:44.422 07:26:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:44.422 07:26:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.422 07:26:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:44.422 { 00:28:44.422 "params": { 00:28:44.422 "name": "Nvme$subsystem", 00:28:44.422 "trtype": "$TEST_TRANSPORT", 00:28:44.422 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:44.422 "adrfam": "ipv4", 00:28:44.422 "trsvcid": "$NVMF_PORT", 00:28:44.422 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:44.422 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:44.422 "hdgst": ${hdgst:-false}, 00:28:44.422 "ddgst": ${ddgst:-false} 00:28:44.422 }, 00:28:44.422 "method": "bdev_nvme_attach_controller" 00:28:44.422 } 00:28:44.422 EOF 00:28:44.422 )") 00:28:44.422 07:26:47 -- target/dif.sh@82 -- # gen_fio_conf 00:28:44.422 07:26:47 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.422 07:26:47 -- target/dif.sh@54 -- # local file 00:28:44.422 07:26:47 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:44.422 07:26:47 -- target/dif.sh@56 -- # cat 00:28:44.422 07:26:47 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:44.422 07:26:47 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:44.422 07:26:47 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.422 07:26:47 -- common/autotest_common.sh@1320 -- # shift 00:28:44.422 07:26:47 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:44.422 07:26:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.422 07:26:47 -- nvmf/common.sh@542 -- # cat 00:28:44.422 07:26:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.422 07:26:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:44.422 07:26:47 -- target/dif.sh@72 -- # (( file <= files )) 00:28:44.422 07:26:47 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:44.422 07:26:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:44.423 07:26:47 -- nvmf/common.sh@544 -- # jq . 00:28:44.423 07:26:47 -- nvmf/common.sh@545 -- # IFS=, 00:28:44.423 07:26:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:44.423 "params": { 00:28:44.423 "name": "Nvme0", 00:28:44.423 "trtype": "tcp", 00:28:44.423 "traddr": "10.0.0.2", 00:28:44.423 "adrfam": "ipv4", 00:28:44.423 "trsvcid": "4420", 00:28:44.423 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:44.423 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:44.423 "hdgst": false, 00:28:44.423 "ddgst": false 00:28:44.423 }, 00:28:44.423 "method": "bdev_nvme_attach_controller" 00:28:44.423 }' 00:28:44.423 07:26:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:44.423 07:26:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:44.423 07:26:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:44.423 07:26:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:44.423 07:26:47 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:44.423 07:26:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:44.423 07:26:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:44.423 07:26:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:44.423 07:26:47 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:44.423 07:26:47 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:44.681 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:44.681 fio-3.35 00:28:44.681 Starting 1 thread 00:28:44.681 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.247 [2024-10-16 07:26:47.906158] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:45.247 [2024-10-16 07:26:47.906230] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:55.281 00:28:55.281 filename0: (groupid=0, jobs=1): err= 0: pid=2034737: Wed Oct 16 07:26:58 2024 00:28:55.281 read: IOPS=190, BW=763KiB/s (782kB/s)(7648KiB/10018msec) 00:28:55.281 slat (nsec): min=6511, max=84411, avg=8091.49, stdev=3021.29 00:28:55.281 clat (usec): min=538, max=44756, avg=20932.55, stdev=20420.83 00:28:55.281 lat (usec): min=545, max=44791, avg=20940.64, stdev=20420.59 00:28:55.281 clat percentiles (usec): 00:28:55.281 | 1.00th=[ 570], 5.00th=[ 578], 10.00th=[ 586], 20.00th=[ 594], 00:28:55.281 | 30.00th=[ 603], 40.00th=[ 619], 50.00th=[ 685], 60.00th=[41157], 00:28:55.281 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:28:55.281 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:28:55.281 | 99.99th=[44827] 00:28:55.281 bw ( KiB/s): min= 672, max= 832, per=99.94%, avg=763.20, stdev=36.37, samples=20 00:28:55.281 iops : min= 168, max= 208, avg=190.80, stdev= 9.09, samples=20 00:28:55.281 lat (usec) : 750=50.00%, 1000=0.21% 00:28:55.281 lat (msec) : 50=49.79% 00:28:55.281 cpu : usr=92.18%, sys=7.53%, ctx=16, majf=0, minf=311 00:28:55.281 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:55.281 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.281 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.281 issued rwts: total=1912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.281 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:55.281 00:28:55.281 Run status group 0 (all jobs): 00:28:55.281 READ: bw=763KiB/s (782kB/s), 763KiB/s-763KiB/s (782kB/s-782kB/s), io=7648KiB (7832kB), run=10018-10018msec 00:28:55.539 07:26:58 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:55.539 07:26:58 -- target/dif.sh@43 -- # local sub 00:28:55.539 07:26:58 -- target/dif.sh@45 -- # for sub in "$@" 00:28:55.539 07:26:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:55.539 07:26:58 -- target/dif.sh@36 -- # local sub_id=0 00:28:55.539 07:26:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.539 07:26:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.539 00:28:55.539 real 0m11.235s 00:28:55.539 user 0m10.366s 00:28:55.539 sys 0m1.025s 00:28:55.539 07:26:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 ************************************ 00:28:55.539 END TEST fio_dif_1_default 00:28:55.539 ************************************ 00:28:55.539 07:26:58 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:55.539 07:26:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:55.539 07:26:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 ************************************ 00:28:55.539 START TEST fio_dif_1_multi_subsystems 00:28:55.539 ************************************ 00:28:55.539 07:26:58 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:28:55.539 07:26:58 -- target/dif.sh@92 -- # local files=1 00:28:55.539 07:26:58 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:55.539 07:26:58 -- target/dif.sh@28 -- # local sub 00:28:55.539 07:26:58 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.539 07:26:58 -- target/dif.sh@31 -- # create_subsystem 0 00:28:55.539 07:26:58 -- target/dif.sh@18 -- # local sub_id=0 00:28:55.539 07:26:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 bdev_null0 00:28:55.539 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.539 07:26:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.539 07:26:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.539 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.539 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.539 07:26:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:55.539 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.540 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.540 [2024-10-16 07:26:58.425137] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.540 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.540 07:26:58 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.540 07:26:58 -- target/dif.sh@31 -- # create_subsystem 1 00:28:55.540 07:26:58 -- target/dif.sh@18 -- # local sub_id=1 00:28:55.540 07:26:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:55.540 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.540 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.540 bdev_null1 00:28:55.540 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.540 07:26:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:55.540 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.540 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.540 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.540 07:26:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:55.540 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.540 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.540 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.540 07:26:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:55.540 07:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.540 07:26:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.540 07:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.540 07:26:58 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:55.540 07:26:58 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:55.540 07:26:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:55.540 07:26:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.540 07:26:58 -- nvmf/common.sh@520 -- # config=() 00:28:55.540 07:26:58 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.540 07:26:58 -- nvmf/common.sh@520 -- # local subsystem config 00:28:55.540 07:26:58 -- target/dif.sh@82 -- # gen_fio_conf 00:28:55.540 07:26:58 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:55.540 07:26:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.540 07:26:58 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:55.540 07:26:58 -- target/dif.sh@54 -- # local file 00:28:55.540 07:26:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.540 { 00:28:55.540 "params": { 00:28:55.540 "name": "Nvme$subsystem", 00:28:55.540 "trtype": "$TEST_TRANSPORT", 00:28:55.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.540 "adrfam": "ipv4", 00:28:55.540 "trsvcid": "$NVMF_PORT", 00:28:55.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.540 "hdgst": ${hdgst:-false}, 00:28:55.540 "ddgst": ${ddgst:-false} 00:28:55.540 }, 00:28:55.540 "method": "bdev_nvme_attach_controller" 00:28:55.540 } 00:28:55.540 EOF 00:28:55.540 )") 00:28:55.540 07:26:58 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:55.540 07:26:58 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.540 07:26:58 -- target/dif.sh@56 -- # cat 00:28:55.540 07:26:58 -- common/autotest_common.sh@1320 -- # shift 00:28:55.540 07:26:58 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:55.540 07:26:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.540 07:26:58 -- nvmf/common.sh@542 -- # cat 00:28:55.540 07:26:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.540 07:26:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:55.540 07:26:58 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:55.540 07:26:58 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.540 07:26:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:55.540 07:26:58 -- target/dif.sh@73 -- # cat 00:28:55.540 07:26:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.540 07:26:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.540 { 00:28:55.540 "params": { 00:28:55.540 "name": "Nvme$subsystem", 00:28:55.540 "trtype": "$TEST_TRANSPORT", 00:28:55.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.540 "adrfam": "ipv4", 00:28:55.540 "trsvcid": "$NVMF_PORT", 00:28:55.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.540 "hdgst": ${hdgst:-false}, 00:28:55.540 "ddgst": ${ddgst:-false} 00:28:55.540 }, 00:28:55.540 "method": "bdev_nvme_attach_controller" 00:28:55.540 } 00:28:55.540 EOF 00:28:55.540 )") 00:28:55.540 07:26:58 -- target/dif.sh@72 -- # (( file++ )) 00:28:55.540 07:26:58 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.540 07:26:58 -- nvmf/common.sh@542 -- # cat 00:28:55.540 07:26:58 -- nvmf/common.sh@544 -- # jq . 00:28:55.540 07:26:58 -- nvmf/common.sh@545 -- # IFS=, 00:28:55.540 07:26:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:55.540 "params": { 00:28:55.540 "name": "Nvme0", 00:28:55.540 "trtype": "tcp", 00:28:55.540 "traddr": "10.0.0.2", 00:28:55.540 "adrfam": "ipv4", 00:28:55.540 "trsvcid": "4420", 00:28:55.540 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:55.540 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:55.540 "hdgst": false, 00:28:55.540 "ddgst": false 00:28:55.540 }, 00:28:55.540 "method": "bdev_nvme_attach_controller" 00:28:55.540 },{ 00:28:55.540 "params": { 00:28:55.540 "name": "Nvme1", 00:28:55.540 "trtype": "tcp", 00:28:55.540 "traddr": "10.0.0.2", 00:28:55.540 "adrfam": "ipv4", 00:28:55.540 "trsvcid": "4420", 00:28:55.540 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:55.540 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:55.540 "hdgst": false, 00:28:55.540 "ddgst": false 00:28:55.540 }, 00:28:55.540 "method": "bdev_nvme_attach_controller" 00:28:55.540 }' 00:28:55.799 07:26:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:55.799 07:26:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:55.799 07:26:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.799 07:26:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.799 07:26:58 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:55.799 07:26:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:55.799 07:26:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:55.799 07:26:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:55.799 07:26:58 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:55.799 07:26:58 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.799 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:55.799 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:55.799 fio-3.35 00:28:55.799 Starting 2 threads 00:28:56.057 EAL: No free 2048 kB hugepages reported on node 1 00:28:56.623 [2024-10-16 07:26:59.285451] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:56.623 [2024-10-16 07:26:59.285504] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:06.587 00:29:06.587 filename0: (groupid=0, jobs=1): err= 0: pid=2036188: Wed Oct 16 07:27:09 2024 00:29:06.587 read: IOPS=193, BW=775KiB/s (794kB/s)(7760KiB/10012msec) 00:29:06.587 slat (nsec): min=4354, max=83648, avg=9579.61, stdev=3792.90 00:29:06.587 clat (usec): min=544, max=45233, avg=20611.76, stdev=20344.65 00:29:06.587 lat (usec): min=552, max=45246, avg=20621.34, stdev=20344.23 00:29:06.587 clat percentiles (usec): 00:29:06.587 | 1.00th=[ 570], 5.00th=[ 586], 10.00th=[ 611], 20.00th=[ 635], 00:29:06.587 | 30.00th=[ 644], 40.00th=[ 668], 50.00th=[ 873], 60.00th=[41157], 00:29:06.587 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:06.587 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45351], 99.95th=[45351], 00:29:06.587 | 99.99th=[45351] 00:29:06.587 bw ( KiB/s): min= 704, max= 832, per=66.55%, avg=774.40, stdev=35.36, samples=20 00:29:06.587 iops : min= 176, max= 208, avg=193.60, stdev= 8.84, samples=20 00:29:06.587 lat (usec) : 750=48.25%, 1000=2.47% 00:29:06.587 lat (msec) : 2=0.21%, 50=49.07% 00:29:06.587 cpu : usr=95.81%, sys=3.70%, ctx=40, majf=0, minf=185 00:29:06.587 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.587 issued rwts: total=1940,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:06.587 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:06.587 filename1: (groupid=0, jobs=1): err= 0: pid=2036189: Wed Oct 16 07:27:09 2024 00:29:06.587 read: IOPS=97, BW=389KiB/s (399kB/s)(3904KiB/10029msec) 00:29:06.587 slat (nsec): min=4574, max=26396, avg=9758.70, stdev=3404.34 00:29:06.587 clat (usec): min=40687, max=46569, avg=41068.63, stdev=442.90 00:29:06.587 lat (usec): min=40696, max=46594, avg=41078.39, stdev=443.14 00:29:06.587 clat percentiles (usec): 00:29:06.587 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:06.587 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:06.587 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:29:06.587 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46400], 99.95th=[46400], 00:29:06.587 | 99.99th=[46400] 00:29:06.587 bw ( KiB/s): min= 384, max= 416, per=33.36%, avg=388.80, stdev=11.72, samples=20 00:29:06.587 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:06.587 lat (msec) : 50=100.00% 00:29:06.587 cpu : usr=96.00%, sys=3.59%, ctx=49, majf=0, minf=187 00:29:06.587 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.587 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:06.587 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:06.587 00:29:06.587 Run status group 0 (all jobs): 00:29:06.587 READ: bw=1163KiB/s (1191kB/s), 389KiB/s-775KiB/s (399kB/s-794kB/s), io=11.4MiB (11.9MB), run=10012-10029msec 00:29:06.846 07:27:09 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:06.846 07:27:09 -- target/dif.sh@43 -- # local sub 00:29:06.846 07:27:09 -- target/dif.sh@45 -- # for sub in "$@" 00:29:06.846 07:27:09 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:06.846 07:27:09 -- target/dif.sh@36 -- # local sub_id=0 00:29:06.846 07:27:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:06.846 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:06.846 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:06.846 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:06.846 07:27:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:06.846 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:06.846 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:06.846 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:06.846 07:27:09 -- target/dif.sh@45 -- # for sub in "$@" 00:29:06.846 07:27:09 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:06.846 07:27:09 -- target/dif.sh@36 -- # local sub_id=1 00:29:06.846 07:27:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:06.846 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:06.846 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:06.846 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:06.846 07:27:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:06.846 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:06.846 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:06.846 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:06.846 00:29:06.846 real 0m11.369s 00:29:06.846 user 0m20.591s 00:29:06.846 sys 0m1.059s 00:29:06.846 07:27:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:06.846 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:06.846 ************************************ 00:29:06.846 END TEST fio_dif_1_multi_subsystems 00:29:06.846 ************************************ 00:29:07.105 07:27:09 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:07.105 07:27:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:07.105 07:27:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:07.105 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.105 ************************************ 00:29:07.105 START TEST fio_dif_rand_params 00:29:07.105 ************************************ 00:29:07.105 07:27:09 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:29:07.105 07:27:09 -- target/dif.sh@100 -- # local NULL_DIF 00:29:07.105 07:27:09 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:07.105 07:27:09 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:07.105 07:27:09 -- target/dif.sh@103 -- # bs=128k 00:29:07.105 07:27:09 -- target/dif.sh@103 -- # numjobs=3 00:29:07.105 07:27:09 -- target/dif.sh@103 -- # iodepth=3 00:29:07.105 07:27:09 -- target/dif.sh@103 -- # runtime=5 00:29:07.105 07:27:09 -- target/dif.sh@105 -- # create_subsystems 0 00:29:07.105 07:27:09 -- target/dif.sh@28 -- # local sub 00:29:07.105 07:27:09 -- target/dif.sh@30 -- # for sub in "$@" 00:29:07.105 07:27:09 -- target/dif.sh@31 -- # create_subsystem 0 00:29:07.105 07:27:09 -- target/dif.sh@18 -- # local sub_id=0 00:29:07.105 07:27:09 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:07.105 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.105 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.105 bdev_null0 00:29:07.105 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.105 07:27:09 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:07.105 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.105 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.105 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.105 07:27:09 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:07.105 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.105 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.105 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.105 07:27:09 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:07.105 07:27:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.105 07:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.105 [2024-10-16 07:27:09.824694] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:07.105 07:27:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.105 07:27:09 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:07.105 07:27:09 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:07.105 07:27:09 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:07.105 07:27:09 -- nvmf/common.sh@520 -- # config=() 00:29:07.105 07:27:09 -- nvmf/common.sh@520 -- # local subsystem config 00:29:07.105 07:27:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:07.105 07:27:09 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:07.105 07:27:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:07.105 { 00:29:07.105 "params": { 00:29:07.105 "name": "Nvme$subsystem", 00:29:07.105 "trtype": "$TEST_TRANSPORT", 00:29:07.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:07.105 "adrfam": "ipv4", 00:29:07.105 "trsvcid": "$NVMF_PORT", 00:29:07.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:07.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:07.105 "hdgst": ${hdgst:-false}, 00:29:07.105 "ddgst": ${ddgst:-false} 00:29:07.105 }, 00:29:07.105 "method": "bdev_nvme_attach_controller" 00:29:07.105 } 00:29:07.105 EOF 00:29:07.105 )") 00:29:07.105 07:27:09 -- target/dif.sh@82 -- # gen_fio_conf 00:29:07.105 07:27:09 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:07.105 07:27:09 -- target/dif.sh@54 -- # local file 00:29:07.105 07:27:09 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:29:07.105 07:27:09 -- target/dif.sh@56 -- # cat 00:29:07.105 07:27:09 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:07.105 07:27:09 -- common/autotest_common.sh@1318 -- # local sanitizers 00:29:07.105 07:27:09 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.105 07:27:09 -- common/autotest_common.sh@1320 -- # shift 00:29:07.105 07:27:09 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:29:07.105 07:27:09 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:07.105 07:27:09 -- nvmf/common.sh@542 -- # cat 00:29:07.105 07:27:09 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.105 07:27:09 -- target/dif.sh@72 -- # (( file <= files )) 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # grep libasan 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:07.105 07:27:09 -- nvmf/common.sh@544 -- # jq . 00:29:07.105 07:27:09 -- nvmf/common.sh@545 -- # IFS=, 00:29:07.105 07:27:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:07.105 "params": { 00:29:07.105 "name": "Nvme0", 00:29:07.105 "trtype": "tcp", 00:29:07.105 "traddr": "10.0.0.2", 00:29:07.105 "adrfam": "ipv4", 00:29:07.105 "trsvcid": "4420", 00:29:07.105 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:07.105 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:07.105 "hdgst": false, 00:29:07.105 "ddgst": false 00:29:07.105 }, 00:29:07.105 "method": "bdev_nvme_attach_controller" 00:29:07.105 }' 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:07.105 07:27:09 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:07.105 07:27:09 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:07.105 07:27:09 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:07.105 07:27:09 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:07.105 07:27:09 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:07.105 07:27:09 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:07.364 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:07.364 ... 00:29:07.364 fio-3.35 00:29:07.364 Starting 3 threads 00:29:07.364 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.930 [2024-10-16 07:27:10.691945] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:07.930 [2024-10-16 07:27:10.692002] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:13.191 00:29:13.191 filename0: (groupid=0, jobs=1): err= 0: pid=2038250: Wed Oct 16 07:27:15 2024 00:29:13.191 read: IOPS=229, BW=28.7MiB/s (30.1MB/s)(144MiB/5007msec) 00:29:13.191 slat (nsec): min=5903, max=48252, avg=17824.35, stdev=4207.89 00:29:13.191 clat (usec): min=6918, max=55530, avg=13039.22, stdev=7246.68 00:29:13.191 lat (usec): min=6935, max=55549, avg=13057.04, stdev=7246.42 00:29:13.191 clat percentiles (usec): 00:29:13.191 | 1.00th=[ 7898], 5.00th=[ 9372], 10.00th=[10028], 20.00th=[10552], 00:29:13.191 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11994], 00:29:13.191 | 70.00th=[12518], 80.00th=[13173], 90.00th=[14091], 95.00th=[15139], 00:29:13.191 | 99.00th=[51643], 99.50th=[52167], 99.90th=[55313], 99.95th=[55313], 00:29:13.191 | 99.99th=[55313] 00:29:13.191 bw ( KiB/s): min=22272, max=34048, per=32.61%, avg=29363.20, stdev=3413.44, samples=10 00:29:13.191 iops : min= 174, max= 266, avg=229.40, stdev=26.67, samples=10 00:29:13.191 lat (msec) : 10=9.39%, 20=87.22%, 50=0.96%, 100=2.43% 00:29:13.191 cpu : usr=94.95%, sys=4.57%, ctx=13, majf=0, minf=109 00:29:13.191 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 issued rwts: total=1150,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.191 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.191 filename0: (groupid=0, jobs=1): err= 0: pid=2038251: Wed Oct 16 07:27:15 2024 00:29:13.191 read: IOPS=233, BW=29.2MiB/s (30.6MB/s)(148MiB/5047msec) 00:29:13.191 slat (nsec): min=5163, max=52474, avg=16852.80, stdev=4412.14 00:29:13.191 clat (usec): min=5327, max=55932, avg=12775.70, stdev=5153.31 00:29:13.191 lat (usec): min=5339, max=55952, avg=12792.55, stdev=5153.46 00:29:13.191 clat percentiles (usec): 00:29:13.191 | 1.00th=[ 6063], 5.00th=[ 8029], 10.00th=[ 8717], 20.00th=[10814], 00:29:13.191 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12256], 60.00th=[12780], 00:29:13.191 | 70.00th=[13698], 80.00th=[14353], 90.00th=[15270], 95.00th=[15795], 00:29:13.191 | 99.00th=[49021], 99.50th=[52691], 99.90th=[55313], 99.95th=[55837], 00:29:13.191 | 99.99th=[55837] 00:29:13.191 bw ( KiB/s): min=26112, max=33024, per=33.47%, avg=30131.20, stdev=2257.87, samples=10 00:29:13.191 iops : min= 204, max= 258, avg=235.40, stdev=17.64, samples=10 00:29:13.191 lat (msec) : 10=14.49%, 20=84.07%, 50=0.59%, 100=0.85% 00:29:13.191 cpu : usr=95.76%, sys=3.73%, ctx=14, majf=0, minf=123 00:29:13.191 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 issued rwts: total=1180,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.191 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.191 filename0: (groupid=0, jobs=1): err= 0: pid=2038252: Wed Oct 16 07:27:15 2024 00:29:13.191 read: IOPS=243, BW=30.5MiB/s (31.9MB/s)(153MiB/5006msec) 00:29:13.191 slat (nsec): min=5415, max=79695, avg=17189.93, stdev=4971.09 00:29:13.191 clat (usec): min=4363, max=48552, avg=12284.05, stdev=3214.70 00:29:13.191 lat (usec): min=4377, max=48566, avg=12301.24, stdev=3215.24 00:29:13.191 clat percentiles (usec): 00:29:13.191 | 1.00th=[ 4817], 5.00th=[ 7439], 10.00th=[ 8455], 20.00th=[10421], 00:29:13.191 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12387], 60.00th=[12911], 00:29:13.191 | 70.00th=[13698], 80.00th=[14484], 90.00th=[15401], 95.00th=[16057], 00:29:13.191 | 99.00th=[17171], 99.50th=[17957], 99.90th=[48497], 99.95th=[48497], 00:29:13.191 | 99.99th=[48497] 00:29:13.191 bw ( KiB/s): min=27904, max=35072, per=34.64%, avg=31187.70, stdev=2399.64, samples=10 00:29:13.191 iops : min= 218, max= 274, avg=243.60, stdev=18.66, samples=10 00:29:13.191 lat (msec) : 10=17.13%, 20=82.38%, 50=0.49% 00:29:13.191 cpu : usr=90.79%, sys=6.25%, ctx=346, majf=0, minf=145 00:29:13.191 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:13.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:13.191 issued rwts: total=1220,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:13.191 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:13.191 00:29:13.191 Run status group 0 (all jobs): 00:29:13.191 READ: bw=87.9MiB/s (92.2MB/s), 28.7MiB/s-30.5MiB/s (30.1MB/s-31.9MB/s), io=444MiB (465MB), run=5006-5047msec 00:29:13.450 07:27:16 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:13.450 07:27:16 -- target/dif.sh@43 -- # local sub 00:29:13.450 07:27:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:13.450 07:27:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:13.450 07:27:16 -- target/dif.sh@36 -- # local sub_id=0 00:29:13.450 07:27:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # bs=4k 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # numjobs=8 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # iodepth=16 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # runtime= 00:29:13.450 07:27:16 -- target/dif.sh@109 -- # files=2 00:29:13.450 07:27:16 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:13.450 07:27:16 -- target/dif.sh@28 -- # local sub 00:29:13.450 07:27:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:13.450 07:27:16 -- target/dif.sh@31 -- # create_subsystem 0 00:29:13.450 07:27:16 -- target/dif.sh@18 -- # local sub_id=0 00:29:13.450 07:27:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 bdev_null0 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 [2024-10-16 07:27:16.194828] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:13.450 07:27:16 -- target/dif.sh@31 -- # create_subsystem 1 00:29:13.450 07:27:16 -- target/dif.sh@18 -- # local sub_id=1 00:29:13.450 07:27:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 bdev_null1 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:13.450 07:27:16 -- target/dif.sh@31 -- # create_subsystem 2 00:29:13.450 07:27:16 -- target/dif.sh@18 -- # local sub_id=2 00:29:13.450 07:27:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 bdev_null2 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:13.450 07:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:13.450 07:27:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.450 07:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:13.450 07:27:16 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:13.450 07:27:16 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:13.450 07:27:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:13.450 07:27:16 -- nvmf/common.sh@520 -- # config=() 00:29:13.450 07:27:16 -- nvmf/common.sh@520 -- # local subsystem config 00:29:13.450 07:27:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:13.450 07:27:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.450 07:27:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:13.450 { 00:29:13.450 "params": { 00:29:13.450 "name": "Nvme$subsystem", 00:29:13.450 "trtype": "$TEST_TRANSPORT", 00:29:13.450 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:13.450 "adrfam": "ipv4", 00:29:13.450 "trsvcid": "$NVMF_PORT", 00:29:13.450 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:13.450 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:13.450 "hdgst": ${hdgst:-false}, 00:29:13.450 "ddgst": ${ddgst:-false} 00:29:13.450 }, 00:29:13.450 "method": "bdev_nvme_attach_controller" 00:29:13.450 } 00:29:13.450 EOF 00:29:13.450 )") 00:29:13.450 07:27:16 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.450 07:27:16 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:29:13.450 07:27:16 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:13.450 07:27:16 -- common/autotest_common.sh@1318 -- # local sanitizers 00:29:13.451 07:27:16 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.451 07:27:16 -- common/autotest_common.sh@1320 -- # shift 00:29:13.451 07:27:16 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:29:13.451 07:27:16 -- target/dif.sh@82 -- # gen_fio_conf 00:29:13.451 07:27:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.451 07:27:16 -- target/dif.sh@54 -- # local file 00:29:13.451 07:27:16 -- target/dif.sh@56 -- # cat 00:29:13.451 07:27:16 -- nvmf/common.sh@542 -- # cat 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # grep libasan 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:13.451 07:27:16 -- target/dif.sh@73 -- # cat 00:29:13.451 07:27:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:13.451 07:27:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:13.451 { 00:29:13.451 "params": { 00:29:13.451 "name": "Nvme$subsystem", 00:29:13.451 "trtype": "$TEST_TRANSPORT", 00:29:13.451 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:13.451 "adrfam": "ipv4", 00:29:13.451 "trsvcid": "$NVMF_PORT", 00:29:13.451 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:13.451 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:13.451 "hdgst": ${hdgst:-false}, 00:29:13.451 "ddgst": ${ddgst:-false} 00:29:13.451 }, 00:29:13.451 "method": "bdev_nvme_attach_controller" 00:29:13.451 } 00:29:13.451 EOF 00:29:13.451 )") 00:29:13.451 07:27:16 -- nvmf/common.sh@542 -- # cat 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:13.451 07:27:16 -- target/dif.sh@73 -- # cat 00:29:13.451 07:27:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:13.451 07:27:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:13.451 { 00:29:13.451 "params": { 00:29:13.451 "name": "Nvme$subsystem", 00:29:13.451 "trtype": "$TEST_TRANSPORT", 00:29:13.451 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:13.451 "adrfam": "ipv4", 00:29:13.451 "trsvcid": "$NVMF_PORT", 00:29:13.451 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:13.451 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:13.451 "hdgst": ${hdgst:-false}, 00:29:13.451 "ddgst": ${ddgst:-false} 00:29:13.451 }, 00:29:13.451 "method": "bdev_nvme_attach_controller" 00:29:13.451 } 00:29:13.451 EOF 00:29:13.451 )") 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:13.451 07:27:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:13.451 07:27:16 -- nvmf/common.sh@542 -- # cat 00:29:13.451 07:27:16 -- nvmf/common.sh@544 -- # jq . 00:29:13.451 07:27:16 -- nvmf/common.sh@545 -- # IFS=, 00:29:13.451 07:27:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:13.451 "params": { 00:29:13.451 "name": "Nvme0", 00:29:13.451 "trtype": "tcp", 00:29:13.451 "traddr": "10.0.0.2", 00:29:13.451 "adrfam": "ipv4", 00:29:13.451 "trsvcid": "4420", 00:29:13.451 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:13.451 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:13.451 "hdgst": false, 00:29:13.451 "ddgst": false 00:29:13.451 }, 00:29:13.451 "method": "bdev_nvme_attach_controller" 00:29:13.451 },{ 00:29:13.451 "params": { 00:29:13.451 "name": "Nvme1", 00:29:13.451 "trtype": "tcp", 00:29:13.451 "traddr": "10.0.0.2", 00:29:13.451 "adrfam": "ipv4", 00:29:13.451 "trsvcid": "4420", 00:29:13.451 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:13.451 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:13.451 "hdgst": false, 00:29:13.451 "ddgst": false 00:29:13.451 }, 00:29:13.451 "method": "bdev_nvme_attach_controller" 00:29:13.451 },{ 00:29:13.451 "params": { 00:29:13.451 "name": "Nvme2", 00:29:13.451 "trtype": "tcp", 00:29:13.451 "traddr": "10.0.0.2", 00:29:13.451 "adrfam": "ipv4", 00:29:13.451 "trsvcid": "4420", 00:29:13.451 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:13.451 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:13.451 "hdgst": false, 00:29:13.451 "ddgst": false 00:29:13.451 }, 00:29:13.451 "method": "bdev_nvme_attach_controller" 00:29:13.451 }' 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:13.451 07:27:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:13.451 07:27:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:13.451 07:27:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:13.451 07:27:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:13.451 07:27:16 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:13.451 07:27:16 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:13.709 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:13.709 ... 00:29:13.709 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:13.709 ... 00:29:13.709 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:13.709 ... 00:29:13.709 fio-3.35 00:29:13.709 Starting 24 threads 00:29:13.709 EAL: No free 2048 kB hugepages reported on node 1 00:29:14.641 [2024-10-16 07:27:17.387981] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:14.641 [2024-10-16 07:27:17.388054] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:26.843 00:29:26.843 filename0: (groupid=0, jobs=1): err= 0: pid=2039136: Wed Oct 16 07:27:27 2024 00:29:26.843 read: IOPS=351, BW=1405KiB/s (1438kB/s)(14.0MiB/10206msec) 00:29:26.843 slat (usec): min=7, max=105, avg=31.31, stdev= 9.86 00:29:26.843 clat (msec): min=23, max=437, avg=45.28, stdev=58.47 00:29:26.843 lat (msec): min=23, max=437, avg=45.32, stdev=58.47 00:29:26.843 clat percentiles (msec): 00:29:26.843 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.843 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.843 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 103], 00:29:26.843 | 99.00th=[ 321], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 439], 00:29:26.843 | 99.99th=[ 439] 00:29:26.843 bw ( KiB/s): min= 128, max= 2048, per=4.30%, avg=1427.35, stdev=847.16, samples=20 00:29:26.843 iops : min= 32, max= 512, avg=356.80, stdev=211.77, samples=20 00:29:26.843 lat (msec) : 50=93.75%, 100=0.89%, 250=0.95%, 500=4.41% 00:29:26.843 cpu : usr=97.51%, sys=1.46%, ctx=95, majf=0, minf=80 00:29:26.843 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.843 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.843 issued rwts: total=3584,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.843 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.843 filename0: (groupid=0, jobs=1): err= 0: pid=2039137: Wed Oct 16 07:27:27 2024 00:29:26.843 read: IOPS=344, BW=1378KiB/s (1411kB/s)(13.7MiB/10173msec) 00:29:26.843 slat (usec): min=15, max=107, avg=43.31, stdev=13.00 00:29:26.843 clat (msec): min=29, max=358, avg=46.05, stdev=64.25 00:29:26.843 lat (msec): min=29, max=358, avg=46.10, stdev=64.25 00:29:26.843 clat percentiles (msec): 00:29:26.843 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.843 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.843 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 275], 00:29:26.843 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.843 | 99.99th=[ 359] 00:29:26.843 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.35, stdev=877.01, samples=20 00:29:26.843 iops : min= 32, max= 512, avg=348.80, stdev=219.23, samples=20 00:29:26.843 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.844 cpu : usr=97.83%, sys=1.23%, ctx=126, majf=0, minf=49 00:29:26.844 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039138: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=342, BW=1368KiB/s (1401kB/s)(13.6MiB/10167msec) 00:29:26.844 slat (usec): min=7, max=164, avg=63.94, stdev=31.04 00:29:26.844 clat (msec): min=23, max=358, avg=46.26, stdev=64.46 00:29:26.844 lat (msec): min=23, max=358, avg=46.32, stdev=64.46 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.844 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.844 | 99.99th=[ 359] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.17%, avg=1384.95, stdev=869.38, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=346.20, stdev=217.33, samples=20 00:29:26.844 lat (msec) : 50=93.88%, 100=1.06%, 500=5.06% 00:29:26.844 cpu : usr=98.74%, sys=0.83%, ctx=14, majf=0, minf=46 00:29:26.844 IO depths : 1=3.1%, 2=8.9%, 4=24.2%, 8=54.2%, 16=9.5%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.3%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039139: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.844 slat (usec): min=9, max=157, avg=63.59, stdev=27.89 00:29:26.844 clat (msec): min=21, max=366, avg=45.74, stdev=64.14 00:29:26.844 lat (msec): min=21, max=366, avg=45.80, stdev=64.14 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.844 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 55], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 368], 00:29:26.844 | 99.99th=[ 368] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.60, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.844 lat (msec) : 50=94.94%, 100=0.06%, 500=5.00% 00:29:26.844 cpu : usr=98.28%, sys=1.15%, ctx=55, majf=0, minf=51 00:29:26.844 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039140: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.844 slat (nsec): min=7942, max=85665, avg=30410.35, stdev=14382.58 00:29:26.844 clat (msec): min=24, max=358, avg=46.07, stdev=64.07 00:29:26.844 lat (msec): min=24, max=358, avg=46.10, stdev=64.07 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.844 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 39], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.844 | 99.99th=[ 359] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.49, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=350.40, stdev=217.37, samples=20 00:29:26.844 lat (msec) : 50=95.00%, 500=5.00% 00:29:26.844 cpu : usr=98.64%, sys=0.95%, ctx=18, majf=0, minf=51 00:29:26.844 IO depths : 1=3.6%, 2=9.8%, 4=25.0%, 8=52.7%, 16=8.9%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039141: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=348, BW=1393KiB/s (1426kB/s)(13.9MiB/10201msec) 00:29:26.844 slat (nsec): min=4803, max=85999, avg=32713.26, stdev=12709.67 00:29:26.844 clat (msec): min=10, max=559, avg=45.66, stdev=63.48 00:29:26.844 lat (msec): min=10, max=559, avg=45.69, stdev=63.48 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.844 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 99], 00:29:26.844 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 550], 99.95th=[ 558], 00:29:26.844 | 99.99th=[ 558] 00:29:26.844 bw ( KiB/s): min= 112, max= 2048, per=4.27%, avg=1414.40, stdev=864.55, samples=20 00:29:26.844 iops : min= 28, max= 512, avg=353.60, stdev=216.14, samples=20 00:29:26.844 lat (msec) : 20=0.45%, 50=94.14%, 100=0.45%, 250=0.17%, 500=4.62% 00:29:26.844 lat (msec) : 750=0.17% 00:29:26.844 cpu : usr=98.82%, sys=0.77%, ctx=24, majf=0, minf=39 00:29:26.844 IO depths : 1=5.9%, 2=12.2%, 4=24.9%, 8=50.5%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039142: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=344, BW=1378KiB/s (1412kB/s)(13.7MiB/10168msec) 00:29:26.844 slat (usec): min=6, max=109, avg=45.08, stdev=15.21 00:29:26.844 clat (msec): min=29, max=358, avg=46.01, stdev=64.25 00:29:26.844 lat (msec): min=29, max=358, avg=46.05, stdev=64.25 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.844 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 275], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.844 | 99.99th=[ 359] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.20, stdev=875.95, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=348.80, stdev=218.99, samples=20 00:29:26.844 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.844 cpu : usr=98.59%, sys=1.00%, ctx=17, majf=0, minf=50 00:29:26.844 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename0: (groupid=0, jobs=1): err= 0: pid=2039143: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=344, BW=1378KiB/s (1412kB/s)(13.7MiB/10168msec) 00:29:26.844 slat (usec): min=8, max=111, avg=44.76, stdev=15.31 00:29:26.844 clat (msec): min=29, max=358, avg=46.00, stdev=64.23 00:29:26.844 lat (msec): min=29, max=358, avg=46.05, stdev=64.23 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.844 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.844 | 99.99th=[ 359] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.20, stdev=875.95, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=348.80, stdev=218.99, samples=20 00:29:26.844 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.844 cpu : usr=98.69%, sys=0.90%, ctx=15, majf=0, minf=37 00:29:26.844 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename1: (groupid=0, jobs=1): err= 0: pid=2039144: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=348, BW=1393KiB/s (1426kB/s)(13.9MiB/10202msec) 00:29:26.844 slat (nsec): min=7975, max=93405, avg=24983.78, stdev=13163.91 00:29:26.844 clat (msec): min=18, max=337, avg=45.75, stdev=62.01 00:29:26.844 lat (msec): min=18, max=337, avg=45.78, stdev=62.01 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.844 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 99], 00:29:26.844 | 99.00th=[ 330], 99.50th=[ 334], 99.90th=[ 338], 99.95th=[ 338], 00:29:26.844 | 99.99th=[ 338] 00:29:26.844 bw ( KiB/s): min= 128, max= 2048, per=4.27%, avg=1414.40, stdev=864.63, samples=20 00:29:26.844 iops : min= 32, max= 512, avg=353.60, stdev=216.16, samples=20 00:29:26.844 lat (msec) : 20=0.45%, 50=94.14%, 100=0.45%, 500=4.95% 00:29:26.844 cpu : usr=98.53%, sys=1.03%, ctx=24, majf=0, minf=52 00:29:26.844 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:26.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.844 issued rwts: total=3552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.844 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.844 filename1: (groupid=0, jobs=1): err= 0: pid=2039145: Wed Oct 16 07:27:27 2024 00:29:26.844 read: IOPS=345, BW=1383KiB/s (1416kB/s)(13.7MiB/10167msec) 00:29:26.844 slat (usec): min=7, max=114, avg=42.95, stdev=15.78 00:29:26.844 clat (msec): min=9, max=358, avg=45.88, stdev=64.16 00:29:26.844 lat (msec): min=9, max=358, avg=45.92, stdev=64.16 00:29:26.844 clat percentiles (msec): 00:29:26.844 | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.844 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.844 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.844 | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.844 | 99.99th=[ 359] 00:29:26.844 bw ( KiB/s): min= 128, max= 2096, per=4.22%, avg=1400.15, stdev=879.93, samples=20 00:29:26.844 iops : min= 32, max= 524, avg=350.00, stdev=219.96, samples=20 00:29:26.844 lat (msec) : 10=0.11%, 20=0.63%, 50=93.80%, 100=0.46%, 500=5.01% 00:29:26.844 cpu : usr=98.85%, sys=0.74%, ctx=15, majf=0, minf=43 00:29:26.845 IO depths : 1=5.0%, 2=10.8%, 4=23.4%, 8=53.1%, 16=7.8%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=93.8%, 8=0.7%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3516,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039146: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=344, BW=1378KiB/s (1411kB/s)(13.7MiB/10171msec) 00:29:26.845 slat (usec): min=4, max=152, avg=44.46, stdev=25.10 00:29:26.845 clat (msec): min=29, max=358, avg=45.96, stdev=64.25 00:29:26.845 lat (msec): min=29, max=358, avg=46.01, stdev=64.25 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.845 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 284], 00:29:26.845 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.845 | 99.99th=[ 359] 00:29:26.845 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.20, stdev=876.93, samples=20 00:29:26.845 iops : min= 32, max= 512, avg=348.80, stdev=219.23, samples=20 00:29:26.845 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.845 cpu : usr=98.79%, sys=0.76%, ctx=14, majf=0, minf=49 00:29:26.845 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039147: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.845 slat (usec): min=11, max=104, avg=42.99, stdev=13.00 00:29:26.845 clat (msec): min=25, max=358, avg=45.92, stdev=64.09 00:29:26.845 lat (msec): min=25, max=358, avg=45.96, stdev=64.09 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 38], 00:29:26.845 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.845 | 99.99th=[ 359] 00:29:26.845 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.60, samples=20 00:29:26.845 iops : min= 32, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.845 lat (msec) : 50=95.00%, 500=5.00% 00:29:26.845 cpu : usr=98.22%, sys=1.19%, ctx=46, majf=0, minf=55 00:29:26.845 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039148: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=344, BW=1378KiB/s (1411kB/s)(13.7MiB/10174msec) 00:29:26.845 slat (nsec): min=5578, max=94648, avg=42525.99, stdev=14780.76 00:29:26.845 clat (msec): min=29, max=366, avg=46.06, stdev=64.24 00:29:26.845 lat (msec): min=29, max=366, avg=46.10, stdev=64.24 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.845 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 368], 00:29:26.845 | 99.99th=[ 368] 00:29:26.845 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.20, stdev=876.93, samples=20 00:29:26.845 iops : min= 32, max= 512, avg=348.80, stdev=219.23, samples=20 00:29:26.845 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.845 cpu : usr=98.66%, sys=0.93%, ctx=14, majf=0, minf=29 00:29:26.845 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039149: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=345, BW=1382KiB/s (1415kB/s)(13.8MiB/10186msec) 00:29:26.845 slat (nsec): min=7674, max=50432, avg=13022.17, stdev=7068.85 00:29:26.845 clat (msec): min=30, max=559, avg=46.17, stdev=64.48 00:29:26.845 lat (msec): min=30, max=559, avg=46.18, stdev=64.49 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 101], 00:29:26.845 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 550], 99.95th=[ 558], 00:29:26.845 | 99.99th=[ 558] 00:29:26.845 bw ( KiB/s): min= 112, max= 2048, per=4.23%, avg=1401.60, stdev=869.62, samples=20 00:29:26.845 iops : min= 28, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.845 lat (msec) : 50=94.55%, 100=0.17%, 250=0.51%, 500=4.55%, 750=0.23% 00:29:26.845 cpu : usr=98.35%, sys=1.07%, ctx=73, majf=0, minf=34 00:29:26.845 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039150: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.845 slat (usec): min=8, max=143, avg=36.96, stdev=16.05 00:29:26.845 clat (msec): min=24, max=358, avg=45.99, stdev=64.08 00:29:26.845 lat (msec): min=24, max=358, avg=46.03, stdev=64.08 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 44], 00:29:26.845 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.845 | 99.99th=[ 359] 00:29:26.845 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.60, samples=20 00:29:26.845 iops : min= 32, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.845 lat (msec) : 50=95.00%, 500=5.00% 00:29:26.845 cpu : usr=97.70%, sys=1.51%, ctx=82, majf=0, minf=64 00:29:26.845 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename1: (groupid=0, jobs=1): err= 0: pid=2039151: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=349, BW=1397KiB/s (1431kB/s)(13.9MiB/10208msec) 00:29:26.845 slat (usec): min=8, max=100, avg=29.24, stdev= 9.51 00:29:26.845 clat (msec): min=23, max=522, avg=45.52, stdev=60.56 00:29:26.845 lat (msec): min=23, max=522, avg=45.54, stdev=60.55 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 103], 00:29:26.845 | 99.00th=[ 326], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 523], 00:29:26.845 | 99.99th=[ 523] 00:29:26.845 bw ( KiB/s): min= 128, max= 2048, per=4.28%, avg=1420.15, stdev=857.15, samples=20 00:29:26.845 iops : min= 32, max= 512, avg=355.00, stdev=214.27, samples=20 00:29:26.845 lat (msec) : 50=94.22%, 100=0.45%, 250=0.45%, 500=4.82%, 750=0.06% 00:29:26.845 cpu : usr=98.64%, sys=0.95%, ctx=15, majf=0, minf=42 00:29:26.845 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3566,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename2: (groupid=0, jobs=1): err= 0: pid=2039152: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=344, BW=1379KiB/s (1412kB/s)(13.7MiB/10170msec) 00:29:26.845 slat (nsec): min=3878, max=83602, avg=29534.07, stdev=16178.30 00:29:26.845 clat (msec): min=12, max=358, avg=46.15, stdev=64.23 00:29:26.845 lat (msec): min=12, max=358, avg=46.18, stdev=64.23 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.845 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.845 | 99.99th=[ 359] 00:29:26.845 bw ( KiB/s): min= 128, max= 2096, per=4.21%, avg=1396.15, stdev=877.90, samples=20 00:29:26.845 iops : min= 32, max= 524, avg=349.00, stdev=219.46, samples=20 00:29:26.845 lat (msec) : 20=0.40%, 50=93.84%, 100=0.74%, 500=5.02% 00:29:26.845 cpu : usr=97.73%, sys=1.35%, ctx=91, majf=0, minf=29 00:29:26.845 IO depths : 1=5.0%, 2=10.6%, 4=22.4%, 8=54.0%, 16=8.0%, 32=0.0%, >=64=0.0% 00:29:26.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 complete : 0=0.0%, 4=93.6%, 8=1.1%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.845 issued rwts: total=3506,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.845 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.845 filename2: (groupid=0, jobs=1): err= 0: pid=2039153: Wed Oct 16 07:27:27 2024 00:29:26.845 read: IOPS=353, BW=1416KiB/s (1450kB/s)(14.1MiB/10206msec) 00:29:26.845 slat (nsec): min=5494, max=54823, avg=17107.90, stdev=10070.81 00:29:26.845 clat (msec): min=24, max=339, avg=44.82, stdev=53.03 00:29:26.845 lat (msec): min=24, max=339, avg=44.83, stdev=53.03 00:29:26.845 clat percentiles (msec): 00:29:26.845 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:26.845 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.845 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 165], 00:29:26.845 | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 338], 99.95th=[ 338], 00:29:26.845 | 99.99th=[ 338] 00:29:26.845 bw ( KiB/s): min= 176, max= 2048, per=4.34%, avg=1438.40, stdev=830.00, samples=20 00:29:26.845 iops : min= 44, max= 512, avg=359.60, stdev=207.50, samples=20 00:29:26.845 lat (msec) : 50=93.02%, 100=0.94%, 250=2.66%, 500=3.38% 00:29:26.845 cpu : usr=98.83%, sys=0.75%, ctx=17, majf=0, minf=76 00:29:26.846 IO depths : 1=5.9%, 2=11.9%, 4=24.3%, 8=51.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3612,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039154: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=344, BW=1379KiB/s (1412kB/s)(13.7MiB/10167msec) 00:29:26.846 slat (usec): min=15, max=165, avg=44.24, stdev=25.13 00:29:26.846 clat (msec): min=29, max=366, avg=45.95, stdev=64.26 00:29:26.846 lat (msec): min=29, max=366, avg=45.99, stdev=64.26 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.846 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 284], 00:29:26.846 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 368], 00:29:26.846 | 99.99th=[ 368] 00:29:26.846 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1395.35, stdev=876.04, samples=20 00:29:26.846 iops : min= 32, max= 512, avg=348.80, stdev=218.99, samples=20 00:29:26.846 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.846 cpu : usr=98.69%, sys=0.87%, ctx=53, majf=0, minf=46 00:29:26.846 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039155: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.846 slat (usec): min=8, max=104, avg=42.78, stdev=13.32 00:29:26.846 clat (msec): min=24, max=358, avg=45.92, stdev=64.09 00:29:26.846 lat (msec): min=24, max=358, avg=45.96, stdev=64.09 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.846 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 39], 00:29:26.846 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.846 | 99.99th=[ 359] 00:29:26.846 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.60, samples=20 00:29:26.846 iops : min= 32, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.846 lat (msec) : 50=95.00%, 500=5.00% 00:29:26.846 cpu : usr=97.95%, sys=1.31%, ctx=83, majf=0, minf=46 00:29:26.846 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039156: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=345, BW=1382KiB/s (1416kB/s)(13.8MiB/10185msec) 00:29:26.846 slat (usec): min=8, max=109, avg=41.37, stdev=15.99 00:29:26.846 clat (msec): min=24, max=358, avg=45.95, stdev=64.10 00:29:26.846 lat (msec): min=24, max=358, avg=45.99, stdev=64.10 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.846 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 44], 00:29:26.846 | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.846 | 99.99th=[ 359] 00:29:26.846 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1401.60, stdev=869.60, samples=20 00:29:26.846 iops : min= 32, max= 512, avg=350.40, stdev=217.40, samples=20 00:29:26.846 lat (msec) : 50=95.00%, 500=5.00% 00:29:26.846 cpu : usr=98.92%, sys=0.66%, ctx=18, majf=0, minf=63 00:29:26.846 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3520,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039157: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=344, BW=1378KiB/s (1411kB/s)(13.7MiB/10167msec) 00:29:26.846 slat (nsec): min=7726, max=98603, avg=34675.83, stdev=19682.10 00:29:26.846 clat (msec): min=18, max=358, avg=46.16, stdev=64.27 00:29:26.846 lat (msec): min=18, max=358, avg=46.20, stdev=64.27 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.846 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 275], 00:29:26.846 | 99.00th=[ 338], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], 00:29:26.846 | 99.99th=[ 359] 00:29:26.846 bw ( KiB/s): min= 128, max= 2128, per=4.20%, avg=1394.55, stdev=876.83, samples=20 00:29:26.846 iops : min= 32, max= 532, avg=348.60, stdev=219.19, samples=20 00:29:26.846 lat (msec) : 20=0.46%, 50=93.77%, 100=0.74%, 500=5.03% 00:29:26.846 cpu : usr=97.04%, sys=1.73%, ctx=142, majf=0, minf=50 00:29:26.846 IO depths : 1=1.8%, 2=7.6%, 4=23.6%, 8=56.1%, 16=10.9%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.0%, 8=0.6%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039158: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=344, BW=1377KiB/s (1410kB/s)(13.7MiB/10176msec) 00:29:26.846 slat (usec): min=9, max=109, avg=43.45, stdev=12.52 00:29:26.846 clat (msec): min=24, max=366, avg=46.07, stdev=64.25 00:29:26.846 lat (msec): min=24, max=366, avg=46.12, stdev=64.25 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:26.846 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 284], 00:29:26.846 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 368], 00:29:26.846 | 99.99th=[ 368] 00:29:26.846 bw ( KiB/s): min= 128, max= 2052, per=4.21%, avg=1396.00, stdev=866.69, samples=20 00:29:26.846 iops : min= 32, max= 513, avg=349.00, stdev=216.67, samples=20 00:29:26.846 lat (msec) : 50=94.52%, 100=0.46%, 500=5.02% 00:29:26.846 cpu : usr=98.71%, sys=0.82%, ctx=44, majf=0, minf=44 00:29:26.846 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 filename2: (groupid=0, jobs=1): err= 0: pid=2039159: Wed Oct 16 07:27:27 2024 00:29:26.846 read: IOPS=349, BW=1398KiB/s (1432kB/s)(13.9MiB/10201msec) 00:29:26.846 slat (nsec): min=4242, max=67353, avg=30657.92, stdev=9484.28 00:29:26.846 clat (msec): min=17, max=337, avg=45.48, stdev=60.27 00:29:26.846 lat (msec): min=17, max=337, avg=45.51, stdev=60.27 00:29:26.846 clat percentiles (msec): 00:29:26.846 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:26.846 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:26.846 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 102], 00:29:26.846 | 99.00th=[ 326], 99.50th=[ 330], 99.90th=[ 338], 99.95th=[ 338], 00:29:26.846 | 99.99th=[ 338] 00:29:26.846 bw ( KiB/s): min= 128, max= 2048, per=4.28%, avg=1420.00, stdev=856.95, samples=20 00:29:26.846 iops : min= 32, max= 512, avg=355.00, stdev=214.24, samples=20 00:29:26.846 lat (msec) : 20=0.45%, 50=93.77%, 100=0.45%, 250=0.84%, 500=4.49% 00:29:26.846 cpu : usr=97.40%, sys=1.45%, ctx=165, majf=0, minf=61 00:29:26.846 IO depths : 1=2.9%, 2=9.2%, 4=25.0%, 8=53.3%, 16=9.5%, 32=0.0%, >=64=0.0% 00:29:26.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:26.846 issued rwts: total=3566,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:26.846 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:26.846 00:29:26.846 Run status group 0 (all jobs): 00:29:26.846 READ: bw=32.4MiB/s (33.9MB/s), 1368KiB/s-1416KiB/s (1401kB/s-1450kB/s), io=330MiB (347MB), run=10167-10208msec 00:29:26.846 07:27:28 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:26.846 07:27:28 -- target/dif.sh@43 -- # local sub 00:29:26.846 07:27:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:26.846 07:27:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:26.846 07:27:28 -- target/dif.sh@36 -- # local sub_id=0 00:29:26.846 07:27:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:26.846 07:27:28 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:26.846 07:27:28 -- target/dif.sh@36 -- # local sub_id=1 00:29:26.846 07:27:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:26.846 07:27:28 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:26.846 07:27:28 -- target/dif.sh@36 -- # local sub_id=2 00:29:26.846 07:27:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:26.846 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.846 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.846 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.846 07:27:28 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:26.846 07:27:28 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:26.847 07:27:28 -- target/dif.sh@115 -- # numjobs=2 00:29:26.847 07:27:28 -- target/dif.sh@115 -- # iodepth=8 00:29:26.847 07:27:28 -- target/dif.sh@115 -- # runtime=5 00:29:26.847 07:27:28 -- target/dif.sh@115 -- # files=1 00:29:26.847 07:27:28 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:26.847 07:27:28 -- target/dif.sh@28 -- # local sub 00:29:26.847 07:27:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:26.847 07:27:28 -- target/dif.sh@31 -- # create_subsystem 0 00:29:26.847 07:27:28 -- target/dif.sh@18 -- # local sub_id=0 00:29:26.847 07:27:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 bdev_null0 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 [2024-10-16 07:27:28.104504] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:26.847 07:27:28 -- target/dif.sh@31 -- # create_subsystem 1 00:29:26.847 07:27:28 -- target/dif.sh@18 -- # local sub_id=1 00:29:26.847 07:27:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 bdev_null1 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:26.847 07:27:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:26.847 07:27:28 -- common/autotest_common.sh@10 -- # set +x 00:29:26.847 07:27:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:26.847 07:27:28 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:26.847 07:27:28 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:26.847 07:27:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:26.847 07:27:28 -- nvmf/common.sh@520 -- # config=() 00:29:26.847 07:27:28 -- nvmf/common.sh@520 -- # local subsystem config 00:29:26.847 07:27:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:26.847 07:27:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:26.847 07:27:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:26.847 { 00:29:26.847 "params": { 00:29:26.847 "name": "Nvme$subsystem", 00:29:26.847 "trtype": "$TEST_TRANSPORT", 00:29:26.847 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:26.847 "adrfam": "ipv4", 00:29:26.847 "trsvcid": "$NVMF_PORT", 00:29:26.847 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:26.847 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:26.847 "hdgst": ${hdgst:-false}, 00:29:26.847 "ddgst": ${ddgst:-false} 00:29:26.847 }, 00:29:26.847 "method": "bdev_nvme_attach_controller" 00:29:26.847 } 00:29:26.847 EOF 00:29:26.847 )") 00:29:26.847 07:27:28 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:26.847 07:27:28 -- target/dif.sh@82 -- # gen_fio_conf 00:29:26.847 07:27:28 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:29:26.847 07:27:28 -- target/dif.sh@54 -- # local file 00:29:26.847 07:27:28 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:26.847 07:27:28 -- target/dif.sh@56 -- # cat 00:29:26.847 07:27:28 -- common/autotest_common.sh@1318 -- # local sanitizers 00:29:26.847 07:27:28 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:26.847 07:27:28 -- common/autotest_common.sh@1320 -- # shift 00:29:26.847 07:27:28 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:29:26.847 07:27:28 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:26.847 07:27:28 -- nvmf/common.sh@542 -- # cat 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:26.847 07:27:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # grep libasan 00:29:26.847 07:27:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:26.847 07:27:28 -- target/dif.sh@73 -- # cat 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:26.847 07:27:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:26.847 07:27:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:26.847 { 00:29:26.847 "params": { 00:29:26.847 "name": "Nvme$subsystem", 00:29:26.847 "trtype": "$TEST_TRANSPORT", 00:29:26.847 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:26.847 "adrfam": "ipv4", 00:29:26.847 "trsvcid": "$NVMF_PORT", 00:29:26.847 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:26.847 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:26.847 "hdgst": ${hdgst:-false}, 00:29:26.847 "ddgst": ${ddgst:-false} 00:29:26.847 }, 00:29:26.847 "method": "bdev_nvme_attach_controller" 00:29:26.847 } 00:29:26.847 EOF 00:29:26.847 )") 00:29:26.847 07:27:28 -- nvmf/common.sh@542 -- # cat 00:29:26.847 07:27:28 -- target/dif.sh@72 -- # (( file++ )) 00:29:26.847 07:27:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:26.847 07:27:28 -- nvmf/common.sh@544 -- # jq . 00:29:26.847 07:27:28 -- nvmf/common.sh@545 -- # IFS=, 00:29:26.847 07:27:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:26.847 "params": { 00:29:26.847 "name": "Nvme0", 00:29:26.847 "trtype": "tcp", 00:29:26.847 "traddr": "10.0.0.2", 00:29:26.847 "adrfam": "ipv4", 00:29:26.847 "trsvcid": "4420", 00:29:26.847 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:26.847 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:26.847 "hdgst": false, 00:29:26.847 "ddgst": false 00:29:26.847 }, 00:29:26.847 "method": "bdev_nvme_attach_controller" 00:29:26.847 },{ 00:29:26.847 "params": { 00:29:26.847 "name": "Nvme1", 00:29:26.847 "trtype": "tcp", 00:29:26.847 "traddr": "10.0.0.2", 00:29:26.847 "adrfam": "ipv4", 00:29:26.847 "trsvcid": "4420", 00:29:26.847 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:26.847 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:26.847 "hdgst": false, 00:29:26.847 "ddgst": false 00:29:26.847 }, 00:29:26.847 "method": "bdev_nvme_attach_controller" 00:29:26.847 }' 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:26.847 07:27:28 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:26.847 07:27:28 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:26.847 07:27:28 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:26.847 07:27:28 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:26.847 07:27:28 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:26.847 07:27:28 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:26.847 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:26.847 ... 00:29:26.847 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:26.847 ... 00:29:26.847 fio-3.35 00:29:26.847 Starting 4 threads 00:29:26.847 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.847 [2024-10-16 07:27:29.053163] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:26.847 [2024-10-16 07:27:29.053231] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:32.112 00:29:32.112 filename0: (groupid=0, jobs=1): err= 0: pid=2040579: Wed Oct 16 07:27:34 2024 00:29:32.112 read: IOPS=1909, BW=14.9MiB/s (15.6MB/s)(74.6MiB/5002msec) 00:29:32.112 slat (nsec): min=6781, max=71560, avg=13882.19, stdev=6500.45 00:29:32.112 clat (usec): min=669, max=7621, avg=4143.90, stdev=453.63 00:29:32.112 lat (usec): min=681, max=7634, avg=4157.78, stdev=453.93 00:29:32.112 clat percentiles (usec): 00:29:32.112 | 1.00th=[ 2671], 5.00th=[ 3621], 10.00th=[ 3851], 20.00th=[ 3949], 00:29:32.112 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:32.112 | 70.00th=[ 4293], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 4621], 00:29:32.112 | 99.00th=[ 5866], 99.50th=[ 6456], 99.90th=[ 7242], 99.95th=[ 7504], 00:29:32.112 | 99.99th=[ 7635] 00:29:32.112 bw ( KiB/s): min=14768, max=16128, per=25.18%, avg=15329.78, stdev=435.43, samples=9 00:29:32.112 iops : min= 1846, max= 2016, avg=1916.22, stdev=54.43, samples=9 00:29:32.112 lat (usec) : 750=0.02%, 1000=0.03% 00:29:32.112 lat (msec) : 2=0.40%, 4=27.41%, 10=72.14% 00:29:32.112 cpu : usr=92.52%, sys=6.94%, ctx=16, majf=0, minf=0 00:29:32.112 IO depths : 1=0.1%, 2=9.8%, 4=62.8%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:32.112 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.112 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.112 issued rwts: total=9552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:32.112 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:32.112 filename0: (groupid=0, jobs=1): err= 0: pid=2040580: Wed Oct 16 07:27:34 2024 00:29:32.112 read: IOPS=1898, BW=14.8MiB/s (15.6MB/s)(74.2MiB/5002msec) 00:29:32.112 slat (nsec): min=6383, max=60819, avg=15193.55, stdev=6617.94 00:29:32.112 clat (usec): min=715, max=7884, avg=4155.88, stdev=512.86 00:29:32.112 lat (usec): min=727, max=7905, avg=4171.07, stdev=513.10 00:29:32.112 clat percentiles (usec): 00:29:32.112 | 1.00th=[ 2409], 5.00th=[ 3589], 10.00th=[ 3818], 20.00th=[ 3949], 00:29:32.112 | 30.00th=[ 4015], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:32.112 | 70.00th=[ 4228], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 4817], 00:29:32.112 | 99.00th=[ 6325], 99.50th=[ 6783], 99.90th=[ 7504], 99.95th=[ 7570], 00:29:32.112 | 99.99th=[ 7898] 00:29:32.112 bw ( KiB/s): min=14768, max=15792, per=25.03%, avg=15235.56, stdev=382.90, samples=9 00:29:32.112 iops : min= 1846, max= 1974, avg=1904.44, stdev=47.86, samples=9 00:29:32.112 lat (usec) : 750=0.02%, 1000=0.15% 00:29:32.112 lat (msec) : 2=0.42%, 4=26.97%, 10=72.44% 00:29:32.112 cpu : usr=94.02%, sys=5.46%, ctx=7, majf=0, minf=9 00:29:32.112 IO depths : 1=0.2%, 2=18.3%, 4=54.3%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:32.112 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.112 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.113 issued rwts: total=9498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:32.113 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:32.113 filename1: (groupid=0, jobs=1): err= 0: pid=2040581: Wed Oct 16 07:27:34 2024 00:29:32.113 read: IOPS=1891, BW=14.8MiB/s (15.5MB/s)(73.9MiB/5001msec) 00:29:32.113 slat (nsec): min=7066, max=61536, avg=14735.62, stdev=6484.41 00:29:32.113 clat (usec): min=733, max=7998, avg=4174.03, stdev=538.07 00:29:32.113 lat (usec): min=745, max=8017, avg=4188.76, stdev=538.14 00:29:32.113 clat percentiles (usec): 00:29:32.113 | 1.00th=[ 2409], 5.00th=[ 3621], 10.00th=[ 3851], 20.00th=[ 3949], 00:29:32.113 | 30.00th=[ 4047], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:32.113 | 70.00th=[ 4293], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 4817], 00:29:32.113 | 99.00th=[ 6456], 99.50th=[ 6980], 99.90th=[ 7570], 99.95th=[ 7767], 00:29:32.113 | 99.99th=[ 8029] 00:29:32.113 bw ( KiB/s): min=14653, max=15728, per=24.90%, avg=15158.78, stdev=363.63, samples=9 00:29:32.113 iops : min= 1831, max= 1966, avg=1894.78, stdev=45.56, samples=9 00:29:32.113 lat (usec) : 750=0.01%, 1000=0.15% 00:29:32.113 lat (msec) : 2=0.50%, 4=25.23%, 10=74.11% 00:29:32.113 cpu : usr=93.46%, sys=6.02%, ctx=8, majf=0, minf=9 00:29:32.113 IO depths : 1=0.1%, 2=17.0%, 4=55.2%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:32.113 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.113 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.113 issued rwts: total=9460,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:32.113 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:32.113 filename1: (groupid=0, jobs=1): err= 0: pid=2040582: Wed Oct 16 07:27:34 2024 00:29:32.113 read: IOPS=1910, BW=14.9MiB/s (15.7MB/s)(74.6MiB/5001msec) 00:29:32.113 slat (usec): min=6, max=113, avg=14.17, stdev= 6.27 00:29:32.113 clat (usec): min=711, max=7728, avg=4136.62, stdev=464.49 00:29:32.113 lat (usec): min=723, max=7741, avg=4150.79, stdev=464.85 00:29:32.113 clat percentiles (usec): 00:29:32.113 | 1.00th=[ 2802], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 3949], 00:29:32.113 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:32.113 | 70.00th=[ 4228], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 4621], 00:29:32.113 | 99.00th=[ 5866], 99.50th=[ 6587], 99.90th=[ 7373], 99.95th=[ 7504], 00:29:32.113 | 99.99th=[ 7701] 00:29:32.113 bw ( KiB/s): min=14816, max=15888, per=25.21%, avg=15345.44, stdev=401.86, samples=9 00:29:32.113 iops : min= 1852, max= 1986, avg=1918.11, stdev=50.33, samples=9 00:29:32.113 lat (usec) : 750=0.01%, 1000=0.06% 00:29:32.113 lat (msec) : 2=0.36%, 4=27.36%, 10=72.21% 00:29:32.113 cpu : usr=93.48%, sys=5.96%, ctx=12, majf=0, minf=0 00:29:32.113 IO depths : 1=0.1%, 2=16.9%, 4=56.0%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:32.113 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.113 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:32.113 issued rwts: total=9554,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:32.113 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:32.113 00:29:32.113 Run status group 0 (all jobs): 00:29:32.113 READ: bw=59.5MiB/s (62.3MB/s), 14.8MiB/s-14.9MiB/s (15.5MB/s-15.7MB/s), io=297MiB (312MB), run=5001-5002msec 00:29:32.113 07:27:34 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:32.113 07:27:34 -- target/dif.sh@43 -- # local sub 00:29:32.113 07:27:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.113 07:27:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:32.113 07:27:34 -- target/dif.sh@36 -- # local sub_id=0 00:29:32.113 07:27:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.113 07:27:34 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:32.113 07:27:34 -- target/dif.sh@36 -- # local sub_id=1 00:29:32.113 07:27:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 00:29:32.113 real 0m24.653s 00:29:32.113 user 4m37.921s 00:29:32.113 sys 0m5.503s 00:29:32.113 07:27:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 ************************************ 00:29:32.113 END TEST fio_dif_rand_params 00:29:32.113 ************************************ 00:29:32.113 07:27:34 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:32.113 07:27:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:32.113 07:27:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 ************************************ 00:29:32.113 START TEST fio_dif_digest 00:29:32.113 ************************************ 00:29:32.113 07:27:34 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:29:32.113 07:27:34 -- target/dif.sh@123 -- # local NULL_DIF 00:29:32.113 07:27:34 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:32.113 07:27:34 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:32.113 07:27:34 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:32.113 07:27:34 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:32.113 07:27:34 -- target/dif.sh@127 -- # numjobs=3 00:29:32.113 07:27:34 -- target/dif.sh@127 -- # iodepth=3 00:29:32.113 07:27:34 -- target/dif.sh@127 -- # runtime=10 00:29:32.113 07:27:34 -- target/dif.sh@128 -- # hdgst=true 00:29:32.113 07:27:34 -- target/dif.sh@128 -- # ddgst=true 00:29:32.113 07:27:34 -- target/dif.sh@130 -- # create_subsystems 0 00:29:32.113 07:27:34 -- target/dif.sh@28 -- # local sub 00:29:32.113 07:27:34 -- target/dif.sh@30 -- # for sub in "$@" 00:29:32.113 07:27:34 -- target/dif.sh@31 -- # create_subsystem 0 00:29:32.113 07:27:34 -- target/dif.sh@18 -- # local sub_id=0 00:29:32.113 07:27:34 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 bdev_null0 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.113 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.113 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.113 07:27:34 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:32.113 07:27:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.114 07:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:32.114 [2024-10-16 07:27:34.499419] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:32.114 07:27:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.114 07:27:34 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:32.114 07:27:34 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:32.114 07:27:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:32.114 07:27:34 -- nvmf/common.sh@520 -- # config=() 00:29:32.114 07:27:34 -- nvmf/common.sh@520 -- # local subsystem config 00:29:32.114 07:27:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:32.114 07:27:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.114 07:27:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:32.114 { 00:29:32.114 "params": { 00:29:32.114 "name": "Nvme$subsystem", 00:29:32.114 "trtype": "$TEST_TRANSPORT", 00:29:32.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:32.114 "adrfam": "ipv4", 00:29:32.114 "trsvcid": "$NVMF_PORT", 00:29:32.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:32.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:32.114 "hdgst": ${hdgst:-false}, 00:29:32.114 "ddgst": ${ddgst:-false} 00:29:32.114 }, 00:29:32.114 "method": "bdev_nvme_attach_controller" 00:29:32.114 } 00:29:32.114 EOF 00:29:32.114 )") 00:29:32.114 07:27:34 -- target/dif.sh@82 -- # gen_fio_conf 00:29:32.114 07:27:34 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.114 07:27:34 -- target/dif.sh@54 -- # local file 00:29:32.114 07:27:34 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:29:32.114 07:27:34 -- target/dif.sh@56 -- # cat 00:29:32.114 07:27:34 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:32.114 07:27:34 -- common/autotest_common.sh@1318 -- # local sanitizers 00:29:32.114 07:27:34 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.114 07:27:34 -- common/autotest_common.sh@1320 -- # shift 00:29:32.114 07:27:34 -- nvmf/common.sh@542 -- # cat 00:29:32.114 07:27:34 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:29:32.114 07:27:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.114 07:27:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:32.114 07:27:34 -- target/dif.sh@72 -- # (( file <= files )) 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # grep libasan 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:32.114 07:27:34 -- nvmf/common.sh@544 -- # jq . 00:29:32.114 07:27:34 -- nvmf/common.sh@545 -- # IFS=, 00:29:32.114 07:27:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:32.114 "params": { 00:29:32.114 "name": "Nvme0", 00:29:32.114 "trtype": "tcp", 00:29:32.114 "traddr": "10.0.0.2", 00:29:32.114 "adrfam": "ipv4", 00:29:32.114 "trsvcid": "4420", 00:29:32.114 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:32.114 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:32.114 "hdgst": true, 00:29:32.114 "ddgst": true 00:29:32.114 }, 00:29:32.114 "method": "bdev_nvme_attach_controller" 00:29:32.114 }' 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:32.114 07:27:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:32.114 07:27:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:29:32.114 07:27:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:29:32.114 07:27:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:29:32.114 07:27:34 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:32.114 07:27:34 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.114 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:32.114 ... 00:29:32.114 fio-3.35 00:29:32.114 Starting 3 threads 00:29:32.114 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.372 [2024-10-16 07:27:35.255188] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:32.372 [2024-10-16 07:27:35.255253] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:44.629 00:29:44.629 filename0: (groupid=0, jobs=1): err= 0: pid=2041354: Wed Oct 16 07:27:45 2024 00:29:44.629 read: IOPS=211, BW=26.4MiB/s (27.7MB/s)(265MiB/10048msec) 00:29:44.629 slat (nsec): min=4871, max=59704, avg=22048.21, stdev=5982.88 00:29:44.629 clat (usec): min=10756, max=53040, avg=14160.30, stdev=1526.67 00:29:44.629 lat (usec): min=10775, max=53057, avg=14182.34, stdev=1526.23 00:29:44.629 clat percentiles (usec): 00:29:44.629 | 1.00th=[11994], 5.00th=[12518], 10.00th=[12780], 20.00th=[13304], 00:29:44.629 | 30.00th=[13566], 40.00th=[13829], 50.00th=[14091], 60.00th=[14353], 00:29:44.629 | 70.00th=[14615], 80.00th=[14877], 90.00th=[15270], 95.00th=[15795], 00:29:44.629 | 99.00th=[16712], 99.50th=[17171], 99.90th=[20841], 99.95th=[49546], 00:29:44.629 | 99.99th=[53216] 00:29:44.629 bw ( KiB/s): min=26112, max=27904, per=34.83%, avg=27120.55, stdev=463.23, samples=20 00:29:44.629 iops : min= 204, max= 218, avg=211.85, stdev= 3.67, samples=20 00:29:44.629 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:29:44.629 cpu : usr=94.45%, sys=4.79%, ctx=46, majf=0, minf=170 00:29:44.629 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:44.629 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 issued rwts: total=2122,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:44.629 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:44.629 filename0: (groupid=0, jobs=1): err= 0: pid=2041355: Wed Oct 16 07:27:45 2024 00:29:44.629 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(249MiB/10046msec) 00:29:44.629 slat (nsec): min=7699, max=52507, avg=16900.87, stdev=5415.90 00:29:44.629 clat (usec): min=12236, max=55651, avg=15079.32, stdev=1538.98 00:29:44.629 lat (usec): min=12254, max=55664, avg=15096.22, stdev=1538.97 00:29:44.629 clat percentiles (usec): 00:29:44.629 | 1.00th=[13042], 5.00th=[13698], 10.00th=[13960], 20.00th=[14353], 00:29:44.629 | 30.00th=[14615], 40.00th=[14746], 50.00th=[15008], 60.00th=[15139], 00:29:44.629 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16188], 95.00th=[16581], 00:29:44.629 | 99.00th=[17695], 99.50th=[17695], 99.90th=[51643], 99.95th=[55837], 00:29:44.629 | 99.99th=[55837] 00:29:44.629 bw ( KiB/s): min=24576, max=26624, per=32.73%, avg=25487.30, stdev=533.06, samples=20 00:29:44.629 iops : min= 192, max= 208, avg=199.10, stdev= 4.18, samples=20 00:29:44.629 lat (msec) : 20=99.85%, 50=0.05%, 100=0.10% 00:29:44.629 cpu : usr=93.02%, sys=6.47%, ctx=26, majf=0, minf=155 00:29:44.629 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:44.629 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 issued rwts: total=1993,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:44.629 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:44.629 filename0: (groupid=0, jobs=1): err= 0: pid=2041356: Wed Oct 16 07:27:45 2024 00:29:44.629 read: IOPS=198, BW=24.9MiB/s (26.1MB/s)(250MiB/10045msec) 00:29:44.629 slat (nsec): min=7881, max=61265, avg=16602.78, stdev=5304.75 00:29:44.629 clat (usec): min=11858, max=54494, avg=15048.83, stdev=1447.55 00:29:44.629 lat (usec): min=11876, max=54507, avg=15065.44, stdev=1447.64 00:29:44.629 clat percentiles (usec): 00:29:44.629 | 1.00th=[13042], 5.00th=[13698], 10.00th=[13960], 20.00th=[14353], 00:29:44.629 | 30.00th=[14615], 40.00th=[14746], 50.00th=[14877], 60.00th=[15139], 00:29:44.629 | 70.00th=[15401], 80.00th=[15664], 90.00th=[16188], 95.00th=[16581], 00:29:44.629 | 99.00th=[17433], 99.50th=[17957], 99.90th=[47449], 99.95th=[54264], 00:29:44.629 | 99.99th=[54264] 00:29:44.629 bw ( KiB/s): min=24576, max=26368, per=32.80%, avg=25536.00, stdev=568.65, samples=20 00:29:44.629 iops : min= 192, max= 206, avg=199.50, stdev= 4.44, samples=20 00:29:44.629 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:29:44.629 cpu : usr=92.63%, sys=6.86%, ctx=31, majf=0, minf=154 00:29:44.629 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:44.629 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:44.629 issued rwts: total=1997,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:44.629 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:44.629 00:29:44.629 Run status group 0 (all jobs): 00:29:44.629 READ: bw=76.0MiB/s (79.7MB/s), 24.8MiB/s-26.4MiB/s (26.0MB/s-27.7MB/s), io=764MiB (801MB), run=10045-10048msec 00:29:44.629 07:27:45 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:44.629 07:27:45 -- target/dif.sh@43 -- # local sub 00:29:44.629 07:27:45 -- target/dif.sh@45 -- # for sub in "$@" 00:29:44.629 07:27:45 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:44.629 07:27:45 -- target/dif.sh@36 -- # local sub_id=0 00:29:44.629 07:27:45 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:44.629 07:27:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.629 07:27:45 -- common/autotest_common.sh@10 -- # set +x 00:29:44.629 07:27:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.629 07:27:45 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:44.629 07:27:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.629 07:27:45 -- common/autotest_common.sh@10 -- # set +x 00:29:44.629 07:27:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.629 00:29:44.629 real 0m11.291s 00:29:44.629 user 0m29.350s 00:29:44.629 sys 0m2.079s 00:29:44.629 07:27:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:44.629 07:27:45 -- common/autotest_common.sh@10 -- # set +x 00:29:44.629 ************************************ 00:29:44.629 END TEST fio_dif_digest 00:29:44.629 ************************************ 00:29:44.629 07:27:45 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:44.629 07:27:45 -- target/dif.sh@147 -- # nvmftestfini 00:29:44.629 07:27:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:44.629 07:27:45 -- nvmf/common.sh@116 -- # sync 00:29:44.629 07:27:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:44.629 07:27:45 -- nvmf/common.sh@119 -- # set +e 00:29:44.629 07:27:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:44.629 07:27:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:44.629 rmmod nvme_tcp 00:29:44.629 rmmod nvme_fabrics 00:29:44.629 rmmod nvme_keyring 00:29:44.629 07:27:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:44.629 07:27:45 -- nvmf/common.sh@123 -- # set -e 00:29:44.629 07:27:45 -- nvmf/common.sh@124 -- # return 0 00:29:44.629 07:27:45 -- nvmf/common.sh@477 -- # '[' -n 2034496 ']' 00:29:44.629 07:27:45 -- nvmf/common.sh@478 -- # killprocess 2034496 00:29:44.629 07:27:45 -- common/autotest_common.sh@926 -- # '[' -z 2034496 ']' 00:29:44.629 07:27:45 -- common/autotest_common.sh@930 -- # kill -0 2034496 00:29:44.629 07:27:45 -- common/autotest_common.sh@931 -- # uname 00:29:44.629 07:27:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:44.629 07:27:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2034496 00:29:44.629 07:27:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:44.629 07:27:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:44.629 07:27:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2034496' 00:29:44.629 killing process with pid 2034496 00:29:44.629 07:27:45 -- common/autotest_common.sh@945 -- # kill 2034496 00:29:44.629 07:27:45 -- common/autotest_common.sh@950 -- # wait 2034496 00:29:44.629 07:27:46 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:44.629 07:27:46 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:44.629 Waiting for block devices as requested 00:29:44.629 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:44.629 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:44.629 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:44.888 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:44.888 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:44.888 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:45.146 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:45.146 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:45.146 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:45.146 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:45.403 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:45.403 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:45.403 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:45.403 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:45.403 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:45.661 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:45.661 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:45.661 07:27:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:45.661 07:27:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:45.661 07:27:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:45.661 07:27:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:45.661 07:27:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:45.661 07:27:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:45.661 07:27:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.193 07:27:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:48.193 00:29:48.193 real 1m8.118s 00:29:48.193 user 6m36.753s 00:29:48.193 sys 0m16.439s 00:29:48.193 07:27:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:48.193 07:27:50 -- common/autotest_common.sh@10 -- # set +x 00:29:48.193 ************************************ 00:29:48.193 END TEST nvmf_dif 00:29:48.193 ************************************ 00:29:48.193 07:27:50 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:48.193 07:27:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:48.193 07:27:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:48.193 07:27:50 -- common/autotest_common.sh@10 -- # set +x 00:29:48.193 ************************************ 00:29:48.193 START TEST nvmf_abort_qd_sizes 00:29:48.193 ************************************ 00:29:48.193 07:27:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:48.193 * Looking for test storage... 00:29:48.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:48.193 07:27:50 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:48.193 07:27:50 -- nvmf/common.sh@7 -- # uname -s 00:29:48.193 07:27:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:48.193 07:27:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:48.193 07:27:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:48.193 07:27:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:48.193 07:27:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:48.193 07:27:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:48.193 07:27:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:48.193 07:27:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:48.193 07:27:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:48.193 07:27:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:48.193 07:27:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.193 07:27:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.193 07:27:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:48.193 07:27:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:48.193 07:27:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:48.193 07:27:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:48.193 07:27:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:48.194 07:27:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:48.194 07:27:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:48.194 07:27:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.194 07:27:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.194 07:27:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.194 07:27:50 -- paths/export.sh@5 -- # export PATH 00:29:48.194 07:27:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.194 07:27:50 -- nvmf/common.sh@46 -- # : 0 00:29:48.194 07:27:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:48.194 07:27:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:48.194 07:27:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:48.194 07:27:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:48.194 07:27:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:48.194 07:27:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:48.194 07:27:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:48.194 07:27:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:48.194 07:27:50 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:48.194 07:27:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:48.194 07:27:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:48.194 07:27:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:48.194 07:27:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:48.194 07:27:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:48.194 07:27:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:48.194 07:27:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:48.194 07:27:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.194 07:27:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:48.194 07:27:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:48.194 07:27:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:48.194 07:27:50 -- common/autotest_common.sh@10 -- # set +x 00:29:50.095 07:27:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:50.095 07:27:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:50.095 07:27:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:50.095 07:27:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:50.095 07:27:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:50.095 07:27:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:50.095 07:27:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:50.095 07:27:52 -- nvmf/common.sh@294 -- # net_devs=() 00:29:50.096 07:27:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:50.096 07:27:52 -- nvmf/common.sh@295 -- # e810=() 00:29:50.096 07:27:52 -- nvmf/common.sh@295 -- # local -ga e810 00:29:50.096 07:27:52 -- nvmf/common.sh@296 -- # x722=() 00:29:50.096 07:27:52 -- nvmf/common.sh@296 -- # local -ga x722 00:29:50.096 07:27:52 -- nvmf/common.sh@297 -- # mlx=() 00:29:50.096 07:27:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:50.096 07:27:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:50.096 07:27:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.096 07:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:50.096 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:50.096 07:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.096 07:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:50.096 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:50.096 07:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.096 07:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.096 07:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.096 07:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:50.096 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:50.096 07:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.096 07:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.096 07:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.096 07:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:50.096 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:50.096 07:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:50.096 07:27:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:50.096 07:27:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:50.096 07:27:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:50.096 07:27:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:50.096 07:27:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:50.096 07:27:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:50.096 07:27:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:50.096 07:27:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:50.096 07:27:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:50.096 07:27:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:50.096 07:27:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:50.096 07:27:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:50.096 07:27:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:50.096 07:27:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:50.096 07:27:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:50.096 07:27:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:50.096 07:27:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:50.096 07:27:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:50.096 07:27:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:50.096 07:27:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:50.096 07:27:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:50.096 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:50.096 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.364 ms 00:29:50.096 00:29:50.096 --- 10.0.0.2 ping statistics --- 00:29:50.096 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.096 rtt min/avg/max/mdev = 0.364/0.364/0.364/0.000 ms 00:29:50.096 07:27:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:50.096 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:50.096 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:29:50.096 00:29:50.096 --- 10.0.0.1 ping statistics --- 00:29:50.096 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.096 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:29:50.096 07:27:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:50.096 07:27:52 -- nvmf/common.sh@410 -- # return 0 00:29:50.096 07:27:52 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:50.096 07:27:52 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:51.032 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:51.032 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:51.032 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:51.032 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:51.032 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:51.032 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:51.290 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:51.290 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:51.290 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:51.290 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:52.225 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:52.225 07:27:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:52.225 07:27:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:52.225 07:27:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:52.225 07:27:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:52.225 07:27:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:52.225 07:27:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:52.225 07:27:55 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:52.225 07:27:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:52.225 07:27:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:52.225 07:27:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.225 07:27:55 -- nvmf/common.sh@469 -- # nvmfpid=2046369 00:29:52.225 07:27:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:52.225 07:27:55 -- nvmf/common.sh@470 -- # waitforlisten 2046369 00:29:52.225 07:27:55 -- common/autotest_common.sh@819 -- # '[' -z 2046369 ']' 00:29:52.225 07:27:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:52.225 07:27:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:52.225 07:27:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:52.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:52.225 07:27:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:52.225 07:27:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.225 [2024-10-16 07:27:55.078441] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:52.225 [2024-10-16 07:27:55.078516] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:52.225 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.225 [2024-10-16 07:27:55.149485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:52.483 [2024-10-16 07:27:55.273317] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:52.483 [2024-10-16 07:27:55.273457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:52.483 [2024-10-16 07:27:55.273473] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:52.483 [2024-10-16 07:27:55.273485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:52.483 [2024-10-16 07:27:55.273573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:52.483 [2024-10-16 07:27:55.273650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:52.483 [2024-10-16 07:27:55.273754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:52.483 [2024-10-16 07:27:55.273759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:53.416 07:27:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:53.416 07:27:56 -- common/autotest_common.sh@852 -- # return 0 00:29:53.416 07:27:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:53.416 07:27:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:53.416 07:27:56 -- common/autotest_common.sh@10 -- # set +x 00:29:53.416 07:27:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:53.416 07:27:56 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:53.416 07:27:56 -- scripts/common.sh@312 -- # local nvmes 00:29:53.416 07:27:56 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:53.416 07:27:56 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:53.416 07:27:56 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:53.416 07:27:56 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:53.416 07:27:56 -- scripts/common.sh@322 -- # uname -s 00:29:53.416 07:27:56 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:53.416 07:27:56 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:53.416 07:27:56 -- scripts/common.sh@327 -- # (( 1 )) 00:29:53.416 07:27:56 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:53.416 07:27:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:53.416 07:27:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:53.416 07:27:56 -- common/autotest_common.sh@10 -- # set +x 00:29:53.416 ************************************ 00:29:53.416 START TEST spdk_target_abort 00:29:53.416 ************************************ 00:29:53.416 07:27:56 -- common/autotest_common.sh@1104 -- # spdk_target 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:53.416 07:27:56 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:53.416 07:27:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:53.416 07:27:56 -- common/autotest_common.sh@10 -- # set +x 00:29:56.695 spdk_targetn1 00:29:56.695 07:27:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:56.695 07:27:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.695 07:27:58 -- common/autotest_common.sh@10 -- # set +x 00:29:56.695 [2024-10-16 07:27:58.955168] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:56.695 07:27:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:56.695 07:27:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.695 07:27:58 -- common/autotest_common.sh@10 -- # set +x 00:29:56.695 07:27:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:56.695 07:27:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.695 07:27:58 -- common/autotest_common.sh@10 -- # set +x 00:29:56.695 07:27:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:56.695 07:27:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:56.695 07:27:58 -- common/autotest_common.sh@10 -- # set +x 00:29:56.695 [2024-10-16 07:27:58.987464] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:56.695 07:27:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:56.695 07:27:58 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:56.696 07:27:58 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:56.696 07:27:58 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:56.696 07:27:58 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:56.696 07:27:58 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:56.696 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.223 Initializing NVMe Controllers 00:29:59.223 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:59.223 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:59.223 Initialization complete. Launching workers. 00:29:59.223 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13177, failed: 0 00:29:59.223 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1258, failed to submit 11919 00:29:59.223 success 750, unsuccess 508, failed 0 00:29:59.480 07:28:02 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:59.480 07:28:02 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:59.480 EAL: No free 2048 kB hugepages reported on node 1 00:30:02.760 Initializing NVMe Controllers 00:30:02.760 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:02.760 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:02.760 Initialization complete. Launching workers. 00:30:02.760 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8364, failed: 0 00:30:02.760 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1221, failed to submit 7143 00:30:02.760 success 326, unsuccess 895, failed 0 00:30:02.760 07:28:05 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:02.760 07:28:05 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:02.760 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.040 Initializing NVMe Controllers 00:30:06.040 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:06.040 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:06.040 Initialization complete. Launching workers. 00:30:06.040 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32801, failed: 0 00:30:06.040 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2752, failed to submit 30049 00:30:06.040 success 546, unsuccess 2206, failed 0 00:30:06.040 07:28:08 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:06.040 07:28:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.040 07:28:08 -- common/autotest_common.sh@10 -- # set +x 00:30:06.040 07:28:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.040 07:28:08 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:06.040 07:28:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.040 07:28:08 -- common/autotest_common.sh@10 -- # set +x 00:30:07.412 07:28:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:07.412 07:28:10 -- target/abort_qd_sizes.sh@62 -- # killprocess 2046369 00:30:07.412 07:28:10 -- common/autotest_common.sh@926 -- # '[' -z 2046369 ']' 00:30:07.412 07:28:10 -- common/autotest_common.sh@930 -- # kill -0 2046369 00:30:07.412 07:28:10 -- common/autotest_common.sh@931 -- # uname 00:30:07.412 07:28:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:07.412 07:28:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2046369 00:30:07.412 07:28:10 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:07.412 07:28:10 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:07.412 07:28:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2046369' 00:30:07.412 killing process with pid 2046369 00:30:07.412 07:28:10 -- common/autotest_common.sh@945 -- # kill 2046369 00:30:07.412 07:28:10 -- common/autotest_common.sh@950 -- # wait 2046369 00:30:07.670 00:30:07.670 real 0m14.373s 00:30:07.670 user 0m57.087s 00:30:07.670 sys 0m2.557s 00:30:07.670 07:28:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:07.670 07:28:10 -- common/autotest_common.sh@10 -- # set +x 00:30:07.670 ************************************ 00:30:07.670 END TEST spdk_target_abort 00:30:07.670 ************************************ 00:30:07.670 07:28:10 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:07.670 07:28:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:07.670 07:28:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:07.670 07:28:10 -- common/autotest_common.sh@10 -- # set +x 00:30:07.670 ************************************ 00:30:07.670 START TEST kernel_target_abort 00:30:07.670 ************************************ 00:30:07.670 07:28:10 -- common/autotest_common.sh@1104 -- # kernel_target 00:30:07.670 07:28:10 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:07.670 07:28:10 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:07.670 07:28:10 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:07.670 07:28:10 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:07.670 07:28:10 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:07.670 07:28:10 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:07.670 07:28:10 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:07.670 07:28:10 -- nvmf/common.sh@627 -- # local block nvme 00:30:07.670 07:28:10 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:07.670 07:28:10 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:07.670 07:28:10 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:07.670 07:28:10 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:08.604 Waiting for block devices as requested 00:30:08.863 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:08.863 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:09.122 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:09.122 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:09.122 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:09.122 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:09.381 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:09.381 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:09.381 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:09.381 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:09.639 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:09.639 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:09.639 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:09.639 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:09.639 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:09.897 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:09.897 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:09.897 07:28:12 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:09.897 07:28:12 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:09.897 07:28:12 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:09.897 07:28:12 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:09.897 07:28:12 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:09.897 No valid GPT data, bailing 00:30:09.897 07:28:12 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:10.155 07:28:12 -- scripts/common.sh@393 -- # pt= 00:30:10.155 07:28:12 -- scripts/common.sh@394 -- # return 1 00:30:10.155 07:28:12 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:10.155 07:28:12 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:10.155 07:28:12 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:10.155 07:28:12 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:10.155 07:28:12 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:10.155 07:28:12 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:10.155 07:28:12 -- nvmf/common.sh@654 -- # echo 1 00:30:10.155 07:28:12 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:10.155 07:28:12 -- nvmf/common.sh@656 -- # echo 1 00:30:10.155 07:28:12 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:10.155 07:28:12 -- nvmf/common.sh@663 -- # echo tcp 00:30:10.155 07:28:12 -- nvmf/common.sh@664 -- # echo 4420 00:30:10.155 07:28:12 -- nvmf/common.sh@665 -- # echo ipv4 00:30:10.156 07:28:12 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:10.156 07:28:12 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:10.156 00:30:10.156 Discovery Log Number of Records 2, Generation counter 2 00:30:10.156 =====Discovery Log Entry 0====== 00:30:10.156 trtype: tcp 00:30:10.156 adrfam: ipv4 00:30:10.156 subtype: current discovery subsystem 00:30:10.156 treq: not specified, sq flow control disable supported 00:30:10.156 portid: 1 00:30:10.156 trsvcid: 4420 00:30:10.156 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:10.156 traddr: 10.0.0.1 00:30:10.156 eflags: none 00:30:10.156 sectype: none 00:30:10.156 =====Discovery Log Entry 1====== 00:30:10.156 trtype: tcp 00:30:10.156 adrfam: ipv4 00:30:10.156 subtype: nvme subsystem 00:30:10.156 treq: not specified, sq flow control disable supported 00:30:10.156 portid: 1 00:30:10.156 trsvcid: 4420 00:30:10.156 subnqn: kernel_target 00:30:10.156 traddr: 10.0.0.1 00:30:10.156 eflags: none 00:30:10.156 sectype: none 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:10.156 07:28:12 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:10.156 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.437 Initializing NVMe Controllers 00:30:13.437 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:13.437 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:13.437 Initialization complete. Launching workers. 00:30:13.437 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 44256, failed: 0 00:30:13.437 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 44256, failed to submit 0 00:30:13.437 success 0, unsuccess 44256, failed 0 00:30:13.437 07:28:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:13.437 07:28:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:13.437 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.717 Initializing NVMe Controllers 00:30:16.717 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:16.717 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:16.717 Initialization complete. Launching workers. 00:30:16.718 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79901, failed: 0 00:30:16.718 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20150, failed to submit 59751 00:30:16.718 success 0, unsuccess 20150, failed 0 00:30:16.718 07:28:19 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:16.718 07:28:19 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:16.718 EAL: No free 2048 kB hugepages reported on node 1 00:30:19.999 Initializing NVMe Controllers 00:30:20.000 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:20.000 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:20.000 Initialization complete. Launching workers. 00:30:20.000 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 77044, failed: 0 00:30:20.000 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19234, failed to submit 57810 00:30:20.000 success 0, unsuccess 19234, failed 0 00:30:20.000 07:28:22 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:20.000 07:28:22 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:20.000 07:28:22 -- nvmf/common.sh@677 -- # echo 0 00:30:20.000 07:28:22 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:20.000 07:28:22 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:20.000 07:28:22 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:20.000 07:28:22 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:20.000 07:28:22 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:20.000 07:28:22 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:20.000 00:30:20.000 real 0m11.801s 00:30:20.000 user 0m5.737s 00:30:20.000 sys 0m2.286s 00:30:20.000 07:28:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:20.000 07:28:22 -- common/autotest_common.sh@10 -- # set +x 00:30:20.000 ************************************ 00:30:20.000 END TEST kernel_target_abort 00:30:20.000 ************************************ 00:30:20.000 07:28:22 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:20.000 07:28:22 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:20.000 07:28:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:20.000 07:28:22 -- nvmf/common.sh@116 -- # sync 00:30:20.000 07:28:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:20.000 07:28:22 -- nvmf/common.sh@119 -- # set +e 00:30:20.000 07:28:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:20.000 07:28:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:20.000 rmmod nvme_tcp 00:30:20.000 rmmod nvme_fabrics 00:30:20.000 rmmod nvme_keyring 00:30:20.000 07:28:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:20.000 07:28:22 -- nvmf/common.sh@123 -- # set -e 00:30:20.000 07:28:22 -- nvmf/common.sh@124 -- # return 0 00:30:20.000 07:28:22 -- nvmf/common.sh@477 -- # '[' -n 2046369 ']' 00:30:20.000 07:28:22 -- nvmf/common.sh@478 -- # killprocess 2046369 00:30:20.000 07:28:22 -- common/autotest_common.sh@926 -- # '[' -z 2046369 ']' 00:30:20.000 07:28:22 -- common/autotest_common.sh@930 -- # kill -0 2046369 00:30:20.000 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2046369) - No such process 00:30:20.000 07:28:22 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2046369 is not found' 00:30:20.000 Process with pid 2046369 is not found 00:30:20.000 07:28:22 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:20.000 07:28:22 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:20.567 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:20.567 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:20.867 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:20.867 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:20.867 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:20.867 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:20.867 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:20.867 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:20.867 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:20.867 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:20.867 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:20.867 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:20.867 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:20.867 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:20.867 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:20.867 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:20.867 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:20.867 07:28:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:20.867 07:28:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:20.867 07:28:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:20.867 07:28:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:20.867 07:28:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:20.867 07:28:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:20.867 07:28:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:23.467 07:28:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:23.467 00:30:23.467 real 0m35.203s 00:30:23.467 user 1m5.183s 00:30:23.467 sys 0m8.133s 00:30:23.467 07:28:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:23.467 07:28:25 -- common/autotest_common.sh@10 -- # set +x 00:30:23.467 ************************************ 00:30:23.467 END TEST nvmf_abort_qd_sizes 00:30:23.467 ************************************ 00:30:23.467 07:28:25 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:30:23.467 07:28:25 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:30:23.467 07:28:25 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:30:23.467 07:28:25 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:30:23.467 07:28:25 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:30:23.467 07:28:25 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:30:23.467 07:28:25 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:30:23.467 07:28:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:23.467 07:28:25 -- common/autotest_common.sh@10 -- # set +x 00:30:23.467 07:28:25 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:30:23.467 07:28:25 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:30:23.467 07:28:25 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:30:23.467 07:28:25 -- common/autotest_common.sh@10 -- # set +x 00:30:24.844 INFO: APP EXITING 00:30:24.844 INFO: killing all VMs 00:30:24.844 INFO: killing vhost app 00:30:24.844 INFO: EXIT DONE 00:30:25.777 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:25.777 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.036 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.036 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.036 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.036 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.036 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.036 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.036 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:26.036 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.036 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.036 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.036 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.036 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.036 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.036 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.036 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:27.411 Cleaning 00:30:27.411 Removing: /var/run/dpdk/spdk0/config 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:27.411 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:27.411 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:27.411 Removing: /var/run/dpdk/spdk1/config 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:27.411 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:27.411 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:27.411 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:27.411 Removing: /var/run/dpdk/spdk2/config 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:27.411 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:27.411 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:27.411 Removing: /var/run/dpdk/spdk3/config 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:27.411 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:27.411 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:27.411 Removing: /var/run/dpdk/spdk4/config 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:27.411 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:27.411 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:27.411 Removing: /dev/shm/bdev_svc_trace.1 00:30:27.411 Removing: /dev/shm/nvmf_trace.0 00:30:27.411 Removing: /dev/shm/spdk_tgt_trace.pid1778565 00:30:27.411 Removing: /var/run/dpdk/spdk0 00:30:27.411 Removing: /var/run/dpdk/spdk1 00:30:27.411 Removing: /var/run/dpdk/spdk2 00:30:27.411 Removing: /var/run/dpdk/spdk3 00:30:27.411 Removing: /var/run/dpdk/spdk4 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1776861 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1777612 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1778565 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1779042 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1780273 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1781300 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1781516 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1781839 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1782060 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1782368 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1782537 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1782697 00:30:27.411 Removing: /var/run/dpdk/spdk_pid1782882 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1783473 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1786637 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1786816 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1787109 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1787249 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1787566 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1787705 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788139 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788276 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788452 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788596 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788760 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1788902 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1789274 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1789549 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1789756 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1789929 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790073 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790136 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790291 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790558 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790709 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1790864 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1791127 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1791291 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1791430 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1791710 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1791853 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1792019 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1792260 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1792446 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1792589 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1792782 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793011 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793177 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793316 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793596 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793741 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1793905 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1794162 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1794327 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1794471 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1794751 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1794889 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1795053 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1795267 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1795472 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1795622 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1795809 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1796044 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1796199 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1796365 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1796637 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1796784 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797036 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797215 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797370 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797546 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797798 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1797875 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1798125 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1800393 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1857223 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1859873 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1867124 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1870470 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1872854 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1873500 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1879090 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1879374 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1882054 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1885886 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1888071 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1894804 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1900210 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1901433 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1902122 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1913179 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1915609 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1918563 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1919784 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1921154 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1921428 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1921586 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1921857 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1922451 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1923824 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1924842 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1925295 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1928907 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1932353 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1936003 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1960446 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1963297 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1967255 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1968276 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1969482 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1972180 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1975206 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1979577 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1979580 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1982518 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1982661 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1982800 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1983081 00:30:27.669 Removing: /var/run/dpdk/spdk_pid1983177 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1984315 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1985530 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1986747 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1987959 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1989180 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1990401 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1994282 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1994620 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1995942 00:30:27.670 Removing: /var/run/dpdk/spdk_pid1996797 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2000606 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2002653 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2006955 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2010630 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2014186 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2014735 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2015156 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2015578 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2016172 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2016733 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2017278 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2017827 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2020494 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2020648 00:30:27.670 Removing: /var/run/dpdk/spdk_pid2024501 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2024677 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2026440 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2031604 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2031609 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2034680 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2036122 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2038179 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2038949 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2040393 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2041289 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2046809 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2047213 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2047617 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2049093 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2049502 00:30:27.928 Removing: /var/run/dpdk/spdk_pid2049911 00:30:27.928 Clean 00:30:27.928 killing process with pid 1748313 00:30:36.045 killing process with pid 1748310 00:30:36.045 killing process with pid 1748312 00:30:36.045 killing process with pid 1748311 00:30:36.045 07:28:38 -- common/autotest_common.sh@1436 -- # return 0 00:30:36.045 07:28:38 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:30:36.045 07:28:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:36.045 07:28:38 -- common/autotest_common.sh@10 -- # set +x 00:30:36.045 07:28:38 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:30:36.045 07:28:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:36.045 07:28:38 -- common/autotest_common.sh@10 -- # set +x 00:30:36.045 07:28:38 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:36.045 07:28:38 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:36.045 07:28:38 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:36.045 07:28:38 -- spdk/autotest.sh@394 -- # hash lcov 00:30:36.045 07:28:38 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:30:36.045 07:28:38 -- spdk/autotest.sh@396 -- # hostname 00:30:36.045 07:28:38 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:36.045 geninfo: WARNING: invalid characters removed from testname! 00:31:02.581 07:29:05 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:05.863 07:29:08 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:08.394 07:29:11 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.679 07:29:13 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.210 07:29:16 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:16.763 07:29:19 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:19.294 07:29:21 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:19.294 07:29:21 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:19.294 07:29:21 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:19.294 07:29:21 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:19.295 07:29:21 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:19.295 07:29:21 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.295 07:29:21 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.295 07:29:21 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.295 07:29:21 -- paths/export.sh@5 -- $ export PATH 00:31:19.295 07:29:21 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.295 07:29:21 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:19.295 07:29:21 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:19.295 07:29:21 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1729056561.XXXXXX 00:31:19.295 07:29:21 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1729056561.b40NoP 00:31:19.295 07:29:21 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:19.295 07:29:21 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:19.295 07:29:21 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:19.295 07:29:21 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:19.295 07:29:21 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:19.295 07:29:21 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:19.295 07:29:21 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:31:19.295 07:29:21 -- common/autotest_common.sh@10 -- $ set +x 00:31:19.295 07:29:21 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:19.295 07:29:21 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:19.295 07:29:21 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:19.295 07:29:21 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:19.295 07:29:21 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:19.295 07:29:21 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:19.295 07:29:21 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:19.295 07:29:21 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:19.295 07:29:21 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:19.295 07:29:21 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:19.295 07:29:21 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:19.295 + [[ -n 1705380 ]] 00:31:19.295 + sudo kill 1705380 00:31:19.305 [Pipeline] } 00:31:19.322 [Pipeline] // stage 00:31:19.327 [Pipeline] } 00:31:19.341 [Pipeline] // timeout 00:31:19.346 [Pipeline] } 00:31:19.360 [Pipeline] // catchError 00:31:19.365 [Pipeline] } 00:31:19.380 [Pipeline] // wrap 00:31:19.386 [Pipeline] } 00:31:19.398 [Pipeline] // catchError 00:31:19.408 [Pipeline] stage 00:31:19.410 [Pipeline] { (Epilogue) 00:31:19.423 [Pipeline] catchError 00:31:19.424 [Pipeline] { 00:31:19.438 [Pipeline] echo 00:31:19.440 Cleanup processes 00:31:19.448 [Pipeline] sh 00:31:19.779 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:19.780 2061868 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:19.794 [Pipeline] sh 00:31:20.077 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:20.078 ++ awk '{print $1}' 00:31:20.078 ++ grep -v 'sudo pgrep' 00:31:20.078 + sudo kill -9 00:31:20.078 + true 00:31:20.088 [Pipeline] sh 00:31:20.370 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:30.349 [Pipeline] sh 00:31:30.630 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:30.630 Artifacts sizes are good 00:31:30.644 [Pipeline] archiveArtifacts 00:31:30.652 Archiving artifacts 00:31:30.780 [Pipeline] sh 00:31:31.062 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:31.074 [Pipeline] cleanWs 00:31:31.083 [WS-CLEANUP] Deleting project workspace... 00:31:31.083 [WS-CLEANUP] Deferred wipeout is used... 00:31:31.089 [WS-CLEANUP] done 00:31:31.091 [Pipeline] } 00:31:31.107 [Pipeline] // catchError 00:31:31.119 [Pipeline] sh 00:31:31.400 + logger -p user.info -t JENKINS-CI 00:31:31.408 [Pipeline] } 00:31:31.422 [Pipeline] // stage 00:31:31.427 [Pipeline] } 00:31:31.442 [Pipeline] // node 00:31:31.447 [Pipeline] End of Pipeline 00:31:31.491 Finished: SUCCESS